Aug 17 14:35:50 user nova-compute[73079]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 14:35:53 user nova-compute[73079]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73079) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73079) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73079) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 14:35:53 user nova-compute[73079]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:35:53 user nova-compute[73079]: INFO nova.virt.driver [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 14:35:53 user nova-compute[73079]: INFO nova.compute.provider_config [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Acquiring lock "singleton_lock" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Acquired lock "singleton_lock" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Releasing lock "singleton_lock" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Full set of CONF: {{(pid=73079) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ******************************************************************************** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Configuration options gathered from: {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ================================================================================ {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] allow_resize_to_same_host      = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] arq_binding_timeout            = 300 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] backdoor_port                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] backdoor_socket                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] block_device_allocate_retries  = 300 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] block_device_allocate_retries_interval = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cert                           = self.pem {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute_monitors               = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] config_dir                     = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] config_drive_format            = iso9660 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] config_source                  = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] console_host                   = user {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] control_exchange               = nova {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cpu_allocation_ratio           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] daemon                         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] debug                          = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] default_access_ip_network_name = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] default_availability_zone      = nova {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] default_ephemeral_format       = ext4 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] default_schedule_zone          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] disk_allocation_ratio          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] enable_new_services            = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] enabled_apis                   = ['osapi_compute'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] enabled_ssl_apis               = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] flat_injected                  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] force_config_drive             = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] force_raw_images               = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] graceful_shutdown_timeout      = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] heal_instance_info_cache_interval = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] host                           = user {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_build_timeout         = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_delete_interval       = 300 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_format                = [instance: %(uuid)s]  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_name_template         = instance-%08x {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_usage_audit           = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_usage_audit_period    = month {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] internal_service_availability_zone = internal {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] key                            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] live_migration_retry_count     = 30 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_config_append              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_dir                        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_file                       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_options                    = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_rotate_interval            = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_rotate_interval_type       = days {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] log_rotation_type              = none {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] long_rpc_timeout               = 1800 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] max_concurrent_builds          = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] max_concurrent_live_migrations = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] max_concurrent_snapshots       = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] max_local_block_devices        = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] max_logfile_count              = 30 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] max_logfile_size_mb            = 200 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] maximum_instance_delete_attempts = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metadata_listen                = 0.0.0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metadata_listen_port           = 8775 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metadata_workers               = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] migrate_max_retries            = -1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] mkisofs_cmd                    = genisoimage {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] my_ip                          = 10.0.0.210 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] network_allocate_retries       = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] osapi_compute_listen_port      = 8774 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] osapi_compute_unique_server_name_scope =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] osapi_compute_workers          = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] password_length                = 12 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] periodic_enable                = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] periodic_fuzzy_delay           = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] pointer_model                  = ps2mouse {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] preallocate_images             = none {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] publish_errors                 = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] pybasedir                      = /opt/stack/nova {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ram_allocation_ratio           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rate_limit_burst               = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rate_limit_except_level        = CRITICAL {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rate_limit_interval            = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reboot_timeout                 = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reclaim_instance_interval      = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] record                         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reimage_timeout_per_gb         = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] report_interval                = 120 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rescue_timeout                 = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reserved_host_cpus             = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reserved_host_disk_mb          = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reserved_host_memory_mb        = 512 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] reserved_huge_pages            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] resize_confirm_window          = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] resize_fs_using_block_device   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] resume_guests_state_on_host_boot = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rpc_response_timeout           = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] run_external_periodic_tasks    = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] running_deleted_instance_action = reap {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] running_deleted_instance_poll_interval = 1800 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] running_deleted_instance_timeout = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler_instance_sync_interval = 120 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_down_time              = 720 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] servicegroup_driver            = db {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] shelved_offload_time           = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] shelved_poll_interval          = 3600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] shutdown_timeout               = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] source_is_ipv6                 = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ssl_only                       = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] state_path                     = /opt/stack/data/nova {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] sync_power_state_interval      = 600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] sync_power_state_pool_size     = 1000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] syslog_log_facility            = LOG_USER {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] tempdir                        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] timeout_nbd                    = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] transport_url                  = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] update_resources_interval      = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_cow_images                 = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_eventlog                   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_journal                    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_json                       = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_rootwrap_daemon            = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_stderr                     = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] use_syslog                     = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vcpu_pin_set                   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plugging_is_fatal          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plugging_timeout           = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] virt_mkfs                      = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] volume_usage_poll_interval     = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] watch_log_file                 = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] web                            = /usr/share/spice-html5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_concurrency.disable_process_locking = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.auth_strategy              = keystone {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.compute_link_prefix        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.dhcp_domain                = novalocal {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.enable_instance_password   = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.glance_link_prefix         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.instance_list_per_project_cells = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.list_records_by_skipping_down_cells = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.local_metadata_per_cell    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.max_limit                  = 1000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.metadata_cache_expiration  = 15 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.neutron_default_tenant_id  = default {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.use_forwarded_for          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.use_neutron_default_nets   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_dynamic_targets = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_jsonfile_path   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.backend                  = dogpile.cache.memcached {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.backend_argument         = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.config_prefix            = cache.oslo {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.dead_timeout             = 60.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.debug_cache_backend      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.enable_retry_client      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.enable_socket_keepalive  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.enabled                  = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.expiration_time          = 600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.hashclient_retry_attempts = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_dead_retry      = 300 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_password        =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_pool_maxsize    = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_sasl_enabled    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.memcache_username        =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.proxies                  = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.retry_attempts           = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.retry_delay              = 0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.socket_keepalive_count   = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.socket_keepalive_idle    = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.socket_keepalive_interval = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.tls_allowed_ciphers      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.tls_cafile               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.tls_certfile             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.tls_enabled              = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cache.tls_keyfile              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.auth_section            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.auth_type               = password {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.cafile                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.certfile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.collect_timing          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.cross_az_attach         = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.debug                   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.endpoint_template       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.http_retries            = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.insecure                = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.keyfile                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.os_region_name          = RegionOne {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.split_loggers           = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cinder.timeout                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.cpu_dedicated_set      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.cpu_shared_set         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.image_type_exclude_list = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.max_concurrent_disk_ops = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.max_disk_devices_to_attach = -1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.resource_provider_association_refresh = 300 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.shutdown_retry_interval = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] conductor.workers              = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] console.allowed_origins        = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] console.ssl_ciphers            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] console.ssl_minimum_version    = default {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] consoleauth.token_ttl          = 600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.cafile                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.certfile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.collect_timing          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.connect_retries         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.connect_retry_delay     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.endpoint_override       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.insecure                = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.keyfile                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.max_version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.min_version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.region_name             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.service_name            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.service_type            = accelerator {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.split_loggers           = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.status_code_retries     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.timeout                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] cyborg.version                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.backend               = sqlalchemy {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.connection            = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.connection_debug      = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.connection_parameters =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.connection_recycle_time = 3600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.connection_trace      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.db_inc_retry_interval = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.db_max_retries        = 20 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.db_max_retry_interval = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.db_retry_interval     = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.max_overflow          = 50 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.max_pool_size         = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.max_retries           = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.mysql_enable_ndb      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.mysql_wsrep_sync_wait = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.pool_timeout          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.retry_interval        = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.slave_connection      = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] database.sqlite_synchronous    = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.backend           = sqlalchemy {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.connection        = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.connection_debug  = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.connection_parameters =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.connection_recycle_time = 3600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.connection_trace  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.db_inc_retry_interval = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.db_max_retries    = 20 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.db_max_retry_interval = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.db_retry_interval = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.max_overflow      = 50 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.max_pool_size     = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.max_retries       = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.mysql_enable_ndb  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.pool_timeout      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.retry_interval    = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.slave_connection  = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] api_database.sqlite_synchronous = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] devices.enabled_mdev_types     = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ephemeral_storage_encryption.enabled = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.api_servers             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.cafile                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.certfile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.collect_timing          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.connect_retries         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.connect_retry_delay     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.debug                   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.default_trusted_certificate_ids = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.enable_certificate_validation = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.enable_rbd_download     = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.endpoint_override       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.insecure                = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.keyfile                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.max_version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.min_version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.num_retries             = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.rbd_ceph_conf           =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.rbd_connect_timeout     = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.rbd_pool                =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.rbd_user                =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.region_name             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.service_name            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.service_type            = image {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.split_loggers           = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.status_code_retries     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.timeout                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.verify_glance_signatures = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] glance.version                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] guestfs.debug                  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.config_drive_cdrom      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.config_drive_inject_password = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.enable_instance_metrics_collection = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.enable_remotefx         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.instances_path_share    =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.iscsi_initiator_list    = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.limit_cpu_features      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.power_state_check_timeframe = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.use_multipath_io        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.volume_attach_retry_count = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.vswitch_name            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] mks.enabled                    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] image_cache.manager_interval   = 2400 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] image_cache.precache_concurrency = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] image_cache.remove_unused_base_images = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] image_cache.subdirectory_name  = _base {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.api_max_retries         = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.api_retry_interval      = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.auth_section            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.auth_type               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.cafile                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.certfile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.collect_timing          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.connect_retries         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.connect_retry_delay     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.endpoint_override       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.insecure                = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.keyfile                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.max_version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.min_version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.partition_key           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.peer_list               = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.region_name             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.serial_console_state_timeout = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.service_name            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.service_type            = baremetal {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.split_loggers           = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.status_code_retries     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.timeout                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ironic.version                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] key_manager.fixed_key          = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.barbican_api_version  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.barbican_endpoint     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.barbican_endpoint_type = public {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.barbican_region_name  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.cafile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.certfile              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.collect_timing        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.insecure              = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.keyfile               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.number_of_retries     = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.retry_delay           = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.send_service_user_token = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.split_loggers         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.timeout               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.verify_ssl            = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican.verify_ssl_path       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.auth_section = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.auth_type = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.cafile   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.certfile = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.collect_timing = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.insecure = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.keyfile  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.split_loggers = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] barbican_service_user.timeout  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.approle_role_id          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.approle_secret_id        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.cafile                   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.certfile                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.collect_timing           = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.insecure                 = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.keyfile                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.kv_mountpoint            = secret {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.kv_version               = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.namespace                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.root_token_id            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.split_loggers            = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.ssl_ca_crt_file          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.timeout                  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.use_ssl                  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.cafile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.certfile              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.collect_timing        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.connect_retries       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.connect_retry_delay   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.endpoint_override     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.insecure              = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.keyfile               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.max_version           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.min_version           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.region_name           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.service_name          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.service_type          = identity {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.split_loggers         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.status_code_retries   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.timeout               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] keystone.version               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.connection_uri         =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_mode               = custom {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: WARNING oslo_config.cfg [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_power_governor_high = performance {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_power_governor_low = powersave {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_power_management   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.device_detach_attempts = 8 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.device_detach_timeout  = 20 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.disk_cachemodes        = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.disk_prefix            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.enabled_perf_events    = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.file_backed_memory     = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.gid_maps               = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.hw_disk_discard        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.hw_machine_type        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_rbd_glance_store_name =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_rbd_pool        = rbd {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_type            = default {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.images_volume_group    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.inject_key             = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.inject_partition       = -2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.inject_password        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.iscsi_iface            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.iser_use_multipath     = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_bandwidth = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_downtime = 500 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_inbound_addr = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_permit_post_copy = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_scheme  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_timeout_action = abort {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_tunnelled = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: WARNING oslo_config.cfg [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 14:35:53 user nova-compute[73079]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 14:35:53 user nova-compute[73079]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 14:35:53 user nova-compute[73079]: and ``live_migration_inbound_addr`` respectively.
Aug 17 14:35:53 user nova-compute[73079]: ).  Its value may be silently ignored in the future.
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.live_migration_with_native_tls = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.max_queues             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.nfs_mount_options      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.num_memory_encrypted_guests = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.num_pcie_ports         = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.pmem_namespaces        = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.quobyte_client_cfg     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rbd_secret_uuid        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rbd_user               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.remote_filesystem_transport = ssh {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rescue_image_id        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rescue_kernel_id       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rescue_ramdisk_id      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.rx_queue_size          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.smbfs_mount_options    =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.snapshot_compression   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.snapshot_image_format  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.sparse_logical_volumes = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.swtpm_enabled          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.swtpm_group            = tss {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.swtpm_user             = tss {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.sysinfo_serial         = unique {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.tb_cache_size          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.tx_queue_size          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.uid_maps               = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.use_virtio_for_bridges = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.virt_type              = kvm {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.volume_clear           = zero {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.volume_clear_size      = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.volume_use_multipath   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_cache_path   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.vzstorage_mount_user   = stack {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.auth_section           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.auth_type              = password {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.cafile                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.certfile               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.collect_timing         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.connect_retries        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.connect_retry_delay    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.default_floating_pool  = public {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.endpoint_override      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.extension_sync_interval = 600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.http_retries           = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.insecure               = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.keyfile                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.max_version            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.min_version            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.ovs_bridge             = br-int {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.physnets               = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.region_name            = RegionOne {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.service_metadata_proxy = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.service_name           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.service_type           = network {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.split_loggers          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.status_code_retries    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.timeout                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] neutron.version                = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] notifications.bdms_in_notifications = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] notifications.default_level    = INFO {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] notifications.notification_format = unversioned {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] notifications.notify_on_state_change = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] pci.alias                      = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] pci.device_spec                = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] pci.report_in_placement        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.auth_section         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.auth_type            = password {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.cafile               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.certfile             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.collect_timing       = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.connect_retries      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.connect_retry_delay  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.default_domain_id    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.default_domain_name  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.domain_id            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.domain_name          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.endpoint_override    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.insecure             = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.keyfile              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.max_version          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.min_version          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.password             = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.project_domain_id    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.project_domain_name  = Default {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.project_id           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.project_name         = service {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.region_name          = RegionOne {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.service_name         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.service_type         = placement {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.split_loggers        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.status_code_retries  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.system_scope         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.timeout              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.trust_id             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.user_domain_id       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.user_domain_name     = Default {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.user_id              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.username             = placement {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] placement.version              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.cores                    = 20 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.count_usage_from_placement = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.injected_file_content_bytes = 10240 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.injected_file_path_length = 255 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.injected_files           = 5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.instances                = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.key_pairs                = 100 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.metadata_items           = 128 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.ram                      = 51200 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.recheck_quota            = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.server_group_members     = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] quota.server_groups            = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rdp.enabled                    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.image_metadata_prefilter = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.max_attempts         = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.max_placement_results = 1000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.query_placement_for_availability_zone = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.query_placement_for_image_type_support = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] scheduler.workers              = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.host_subset_size = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.isolated_hosts = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.isolated_images = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.pci_in_placement = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.track_instance_changes = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metrics.required               = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metrics.weight_multiplier      = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] metrics.weight_setting         = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] serial_console.enabled         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] serial_console.port_range      = 10000:20000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] serial_console.serialproxy_port = 6083 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.auth_section      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.auth_type         = password {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.cafile            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.certfile          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.collect_timing    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.insecure          = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.keyfile           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.send_service_user_token = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.split_loggers     = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] service_user.timeout           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.agent_enabled            = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.enabled                  = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.html5proxy_port          = 6082 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.image_compression        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.jpeg_compression         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.playback_compression     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.server_listen            = 127.0.0.1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.streaming_mode           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] spice.zlib_compression         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] upgrade_levels.baseapi         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] upgrade_levels.cert            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] upgrade_levels.compute         = auto {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] upgrade_levels.conductor       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] upgrade_levels.scheduler       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.auth_section = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.auth_type = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.cafile = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.certfile = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.insecure = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.keyfile = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vendordata_dynamic_auth.timeout = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.api_retry_count         = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.ca_file                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.cache_prefix            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.cluster_name            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.connection_pool_size    = 10 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.console_delay_seconds   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.datastore_regex         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.host_ip                 = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.host_password           = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.host_port               = 443 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.host_username           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.insecure                = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.integration_bridge      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.maximum_objects         = 100 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.pbm_default_policy      = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.pbm_enabled             = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.pbm_wsdl_location       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.serial_port_proxy_uri   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.serial_port_service_uri = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.task_poll_interval      = 0.5 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.use_linked_clone        = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.vnc_keymap              = en-us {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.vnc_port                = 5900 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vmware.vnc_port_total          = 10000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.auth_schemes               = ['none'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.enabled                    = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.novncproxy_port            = 6080 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.server_listen              = 0.0.0.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.vencrypt_ca_certs          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.vencrypt_client_cert       = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vnc.vencrypt_client_key        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.disable_rootwrap   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.enable_numa_live_migration = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.libvirt_disable_apic = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.client_socket_timeout     = 900 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.default_pool_size         = 1000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.keep_alive                = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.max_header_line           = 16384 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.ssl_ca_file               = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.ssl_cert_file             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.ssl_key_file              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.tcp_keepidle              = 600 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] zvm.ca_file                    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] zvm.cloud_connector_url        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] zvm.reachable_timeout          = 300 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.enforce_new_defaults = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.enforce_scope      = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.policy_default_rule = default {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.policy_file        = policy.yaml {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.connection_string     = messaging:// {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.enabled               = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.es_doc_type           = notification {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.es_scroll_size        = 10000 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.es_scroll_time        = 2m {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.filter_error_trace    = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.hmac_keys             = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.sentinel_service_name = mymaster {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.socket_timeout        = 0.1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.trace_requests        = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler.trace_sqlalchemy      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler_jaeger.process_tags   = {} {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler_jaeger.service_name_prefix = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] profiler_otlp.service_name_prefix = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] remote_debug.host              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] remote_debug.port              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.ssl      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_notifications.retry = -1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_messaging_notifications.transport_url = **** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.auth_section        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.auth_type           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.cafile              = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.certfile            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.collect_timing      = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.connect_retries     = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.connect_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.endpoint_id         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.endpoint_override   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.insecure            = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.keyfile             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.max_version         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.min_version         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.region_name         = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.service_name        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.service_type        = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.split_loggers       = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.status_code_retries = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.status_code_retry_delay = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.timeout             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.valid_interfaces    = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_limit.version             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_reports.file_event_handler = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] oslo_reports.log_dir           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_ovs_privileged.group  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] vif_plug_ovs_privileged.user   = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.flat_interface = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_ovs.isolate_vif         = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:53 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_vif_ovs.per_port_bridge     = False {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] os_brick.lock_path             = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] privsep_osbrick.capabilities   = [21] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] privsep_osbrick.group          = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] privsep_osbrick.helper_command = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] privsep_osbrick.user           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] nova_sys_admin.group           = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] nova_sys_admin.helper_command  = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] nova_sys_admin.user            = None {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG oslo_service.service [None req-efeaca08-6bab-4426-8f6f-5db333d67d3c None None] ******************************************************************************** {{(pid=73079) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 14:35:54 user nova-compute[73079]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Starting native event thread {{(pid=73079) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Starting green dispatch thread {{(pid=73079) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Starting connection event dispatch thread {{(pid=73079) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Connecting to libvirt: qemu:///system {{(pid=73079) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f27ec488f40> {{(pid=73079) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f27ec488f40> {{(pid=73079) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 14:35:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Connection event '1' reason 'None'
Aug 17 14:35:54 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 14:35:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.mount [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Initialising _HostMountState generation 0 {{(pid=73079) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 14:36:01 user nova-compute[73079]: INFO nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host capabilities <capabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <host>
Aug 17 14:36:01 user nova-compute[73079]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 14:36:01 user nova-compute[73079]:     <cpu>
Aug 17 14:36:01 user nova-compute[73079]:       <arch>x86_64</arch>
Aug 17 14:36:01 user nova-compute[73079]:       <model>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <microcode version='1070'/>
Aug 17 14:36:01 user nova-compute[73079]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='osxsave'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='invtsc'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='rsba'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 14:36:01 user nova-compute[73079]:       <pages unit='KiB' size='4'/>
Aug 17 14:36:01 user nova-compute[73079]:       <pages unit='KiB' size='2048'/>
Aug 17 14:36:01 user nova-compute[73079]:     </cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <power_management>
Aug 17 14:36:01 user nova-compute[73079]:       <suspend_mem/>
Aug 17 14:36:01 user nova-compute[73079]:       <suspend_disk/>
Aug 17 14:36:01 user nova-compute[73079]:       <suspend_hybrid/>
Aug 17 14:36:01 user nova-compute[73079]:     </power_management>
Aug 17 14:36:01 user nova-compute[73079]:     <iommu support='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <migration_features>
Aug 17 14:36:01 user nova-compute[73079]:       <live/>
Aug 17 14:36:01 user nova-compute[73079]:       <uri_transports>
Aug 17 14:36:01 user nova-compute[73079]:         <uri_transport>tcp</uri_transport>
Aug 17 14:36:01 user nova-compute[73079]:         <uri_transport>rdma</uri_transport>
Aug 17 14:36:01 user nova-compute[73079]:       </uri_transports>
Aug 17 14:36:01 user nova-compute[73079]:     </migration_features>
Aug 17 14:36:01 user nova-compute[73079]:     <topology>
Aug 17 14:36:01 user nova-compute[73079]:       <cells num='2'>
Aug 17 14:36:01 user nova-compute[73079]:         <cell id='0'>
Aug 17 14:36:01 user nova-compute[73079]:           <memory unit='KiB'>8189224</memory>
Aug 17 14:36:01 user nova-compute[73079]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 17 14:36:01 user nova-compute[73079]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 14:36:01 user nova-compute[73079]:           <distances>
Aug 17 14:36:01 user nova-compute[73079]:             <sibling id='0' value='10'/>
Aug 17 14:36:01 user nova-compute[73079]:             <sibling id='1' value='20'/>
Aug 17 14:36:01 user nova-compute[73079]:           </distances>
Aug 17 14:36:01 user nova-compute[73079]:           <cpus num='6'>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 14:36:01 user nova-compute[73079]:           </cpus>
Aug 17 14:36:01 user nova-compute[73079]:         </cell>
Aug 17 14:36:01 user nova-compute[73079]:         <cell id='1'>
Aug 17 14:36:01 user nova-compute[73079]:           <memory unit='KiB'>8206460</memory>
Aug 17 14:36:01 user nova-compute[73079]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 17 14:36:01 user nova-compute[73079]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 14:36:01 user nova-compute[73079]:           <distances>
Aug 17 14:36:01 user nova-compute[73079]:             <sibling id='0' value='20'/>
Aug 17 14:36:01 user nova-compute[73079]:             <sibling id='1' value='10'/>
Aug 17 14:36:01 user nova-compute[73079]:           </distances>
Aug 17 14:36:01 user nova-compute[73079]:           <cpus num='6'>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 14:36:01 user nova-compute[73079]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 14:36:01 user nova-compute[73079]:           </cpus>
Aug 17 14:36:01 user nova-compute[73079]:         </cell>
Aug 17 14:36:01 user nova-compute[73079]:       </cells>
Aug 17 14:36:01 user nova-compute[73079]:     </topology>
Aug 17 14:36:01 user nova-compute[73079]:     <cache>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 14:36:01 user nova-compute[73079]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 14:36:01 user nova-compute[73079]:     </cache>
Aug 17 14:36:01 user nova-compute[73079]:     <secmodel>
Aug 17 14:36:01 user nova-compute[73079]:       <model>apparmor</model>
Aug 17 14:36:01 user nova-compute[73079]:       <doi>0</doi>
Aug 17 14:36:01 user nova-compute[73079]:     </secmodel>
Aug 17 14:36:01 user nova-compute[73079]:     <secmodel>
Aug 17 14:36:01 user nova-compute[73079]:       <model>dac</model>
Aug 17 14:36:01 user nova-compute[73079]:       <doi>0</doi>
Aug 17 14:36:01 user nova-compute[73079]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 14:36:01 user nova-compute[73079]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 14:36:01 user nova-compute[73079]:     </secmodel>
Aug 17 14:36:01 user nova-compute[73079]:   </host>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='alpha'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>clipper</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='armv6l'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>spitz</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>nuri</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>kzm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sx1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>z2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>tosa</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>n810</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>n800</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>terrier</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>midway</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>microbit</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>verdex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>highbank</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>akita</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>connex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>collie</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='armv7l'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>spitz</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>nuri</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>kzm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sx1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>z2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>tosa</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>n810</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>n800</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>terrier</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>midway</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>microbit</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>verdex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>highbank</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>akita</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>connex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>collie</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='aarch64'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>spitz</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>nuri</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>kzm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sx1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>z2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>tosa</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>n810</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>n800</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>terrier</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>midway</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>microbit</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>verdex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>highbank</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>akita</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>connex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>collie</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <acpi default='on' toggle='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='cris'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='i686'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>isapc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>microvm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='kvm'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <pae/>
Aug 17 14:36:01 user nova-compute[73079]:       <nonpae/>
Aug 17 14:36:01 user nova-compute[73079]:       <acpi default='on' toggle='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:       <apic default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='m68k'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>an5206</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>q800</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='microblaze'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='microblazeel'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='mips'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='16'>malta</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='mipsel'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='16'>malta</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='mips64'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='16'>malta</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>pica61</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>magnum</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='mips64el'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='16'>malta</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>pica61</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>magnum</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='16'>boston</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='ppc'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mac99</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>40p</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>taihu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='ppc64'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>taihu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>40p</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mac99</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='ppc64le'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>taihu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>40p</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>mac99</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='riscv32'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='8'>spike</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='8'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='riscv64'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='8'>spike</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='8'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='s390x'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='sh4'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>shix</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>r2d</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='sh4eb'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>shix</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>r2d</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='sparc'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>LX</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='sparc64'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>niagara</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='x86_64'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>64</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='1'>isapc</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>microvm</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='kvm'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <acpi default='on' toggle='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:       <apic default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='xtensa'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>sim</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>kc705</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ml605</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx200</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx60</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]:   <guest>
Aug 17 14:36:01 user nova-compute[73079]:     <os_type>hvm</os_type>
Aug 17 14:36:01 user nova-compute[73079]:     <arch name='xtensaeb'>
Aug 17 14:36:01 user nova-compute[73079]:       <wordsize>32</wordsize>
Aug 17 14:36:01 user nova-compute[73079]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='4'>sim</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>kc705</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ml605</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>virt</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx200</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>lx60</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 14:36:01 user nova-compute[73079]:       <domain type='qemu'/>
Aug 17 14:36:01 user nova-compute[73079]:     </arch>
Aug 17 14:36:01 user nova-compute[73079]:     <features>
Aug 17 14:36:01 user nova-compute[73079]:       <cpuselection/>
Aug 17 14:36:01 user nova-compute[73079]:       <deviceboot/>
Aug 17 14:36:01 user nova-compute[73079]:       <disksnapshot default='on' toggle='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     </features>
Aug 17 14:36:01 user nova-compute[73079]:   </guest>
Aug 17 14:36:01 user nova-compute[73079]: </capabilities>
Aug 17 14:36:01 user nova-compute[73079]: 
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-q35-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>i686</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='288'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'/>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='lm'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-i440fx-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>i686</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='255'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'/>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='lm'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ide</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-i440fx-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>i686</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='255'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'/>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='lm'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ide</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-q35-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>i686</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='288'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'/>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='lm'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-q35-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>x86_64</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='288'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>efi</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='invtsc'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='rsba'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-i440fx-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>x86_64</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='255'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>efi</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='invtsc'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='rsba'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ide</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-i440fx-6.2</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>x86_64</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='255'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>efi</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='invtsc'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='rsba'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ide</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 14:36:01 user nova-compute[73079]: <domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 14:36:01 user nova-compute[73079]:   <domain>kvm</domain>
Aug 17 14:36:01 user nova-compute[73079]:   <machine>pc-q35-jammy</machine>
Aug 17 14:36:01 user nova-compute[73079]:   <arch>x86_64</arch>
Aug 17 14:36:01 user nova-compute[73079]:   <vcpu max='288'/>
Aug 17 14:36:01 user nova-compute[73079]:   <iothreads supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:   <os supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='firmware'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>efi</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:     <loader supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>rom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pflash</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='readonly'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='secure'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>yes</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>no</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </loader>
Aug 17 14:36:01 user nova-compute[73079]:   </os>
Aug 17 14:36:01 user nova-compute[73079]:   <cpu>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-passthrough' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='hostPassthroughMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='maximum' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='maximumMigratable'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>on</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>off</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='host-model' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <vendor>Intel</vendor>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ss'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='vmx'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pcid'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='hypervisor'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arat'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='umip'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='md-clear'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='invtsc'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibpb'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='ibrs'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-stibp'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='rsba'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='erms'/>
Aug 17 14:36:01 user nova-compute[73079]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:     <mode name='custom' supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>qemu64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>qemu32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>phenom</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>pentium</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>n270</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm64</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>kvm32</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>coreduo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>core2duo</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>athlon</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Westmere</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Snowridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Skylake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>SandyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Penryn</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G5</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G4</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G3</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Opteron_G2</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Opteron_G1</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>IvyBridge</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Icelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Haswell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Rome</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-Milan</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>EPYC</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Dhyana</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cooperlake</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>Conroe</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='no'>Broadwell</model>
Aug 17 14:36:01 user nova-compute[73079]:       <model usable='yes'>486</model>
Aug 17 14:36:01 user nova-compute[73079]:     </mode>
Aug 17 14:36:01 user nova-compute[73079]:   </cpu>
Aug 17 14:36:01 user nova-compute[73079]:   <memoryBacking supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:     <enum name='sourceType'>
Aug 17 14:36:01 user nova-compute[73079]:       <value>file</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>anonymous</value>
Aug 17 14:36:01 user nova-compute[73079]:       <value>memfd</value>
Aug 17 14:36:01 user nova-compute[73079]:     </enum>
Aug 17 14:36:01 user nova-compute[73079]:   </memoryBacking>
Aug 17 14:36:01 user nova-compute[73079]:   <devices>
Aug 17 14:36:01 user nova-compute[73079]:     <disk supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='diskDevice'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>disk</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cdrom</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>floppy</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>lun</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='bus'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>fdc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sata</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </disk>
Aug 17 14:36:01 user nova-compute[73079]:     <graphics supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='type'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>sdl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vnc</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>spice</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egl-headless</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </graphics>
Aug 17 14:36:01 user nova-compute[73079]:     <video supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='modelType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>cirrus</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>vmvga</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>qxl</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>none</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>bochs</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>ramfb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </video>
Aug 17 14:36:01 user nova-compute[73079]:     <hostdev supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='mode'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>subsystem</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='startupPolicy'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>default</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>mandatory</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>requisite</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>optional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='subsysType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>usb</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>pci</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>scsi</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='capsType'/>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='pciBackend'/>
Aug 17 14:36:01 user nova-compute[73079]:     </hostdev>
Aug 17 14:36:01 user nova-compute[73079]:     <rng supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtio-non-transitional</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>random</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>egd</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>builtin</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </rng>
Aug 17 14:36:01 user nova-compute[73079]:     <filesystem supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='driverType'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>path</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>handle</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>virtiofs</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </filesystem>
Aug 17 14:36:01 user nova-compute[73079]:     <tpm supported='yes'>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='model'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-tis</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>tpm-crb</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:       <enum name='backendModel'>
Aug 17 14:36:01 user nova-compute[73079]:         <value>passthrough</value>
Aug 17 14:36:01 user nova-compute[73079]:         <value>emulator</value>
Aug 17 14:36:01 user nova-compute[73079]:       </enum>
Aug 17 14:36:01 user nova-compute[73079]:     </tpm>
Aug 17 14:36:01 user nova-compute[73079]:   </devices>
Aug 17 14:36:01 user nova-compute[73079]:   <features>
Aug 17 14:36:01 user nova-compute[73079]:     <gic supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:     <vmcoreinfo supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <genid supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backingStoreInput supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <backup supported='yes'/>
Aug 17 14:36:01 user nova-compute[73079]:     <sev supported='no'/>
Aug 17 14:36:01 user nova-compute[73079]:   </features>
Aug 17 14:36:01 user nova-compute[73079]: </domainCapabilities>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73079) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73079) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Checking secure boot support for host arch (x86_64) {{(pid=73079) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 14:36:01 user nova-compute[73079]: INFO nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Secure Boot support detected
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] cpu compare xml: <cpu match="exact">
Aug 17 14:36:01 user nova-compute[73079]:   <model>Nehalem</model>
Aug 17 14:36:01 user nova-compute[73079]: </cpu>
Aug 17 14:36:01 user nova-compute[73079]:  {{(pid=73079) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 14:36:01 user nova-compute[73079]: INFO nova.virt.node [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Generated node identity dea4593c-fa71-4579-88eb-51499faa7caf
Aug 17 14:36:01 user nova-compute[73079]: INFO nova.virt.node [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Wrote node identity dea4593c-fa71-4579-88eb-51499faa7caf to /opt/stack/data/nova/compute_id
Aug 17 14:36:01 user nova-compute[73079]: WARNING nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Compute nodes ['dea4593c-fa71-4579-88eb-51499faa7caf'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 14:36:01 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 14:36:01 user nova-compute[73079]: WARNING nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 14:36:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:36:01 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:36:01 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Hypervisor/Node resource view: name=user free_ram=10941MB free_disk=26.33475112915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:36:01 user nova-compute[73079]: WARNING nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] No compute node record for user:dea4593c-fa71-4579-88eb-51499faa7caf: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host dea4593c-fa71-4579-88eb-51499faa7caf could not be found.
Aug 17 14:36:01 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Compute node record created for user:user with uuid: dea4593c-fa71-4579-88eb-51499faa7caf
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:36:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:36:02 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [req-ff5e052e-6a95-43e9-bada-da550c39222d] Created resource provider record via placement API for resource provider with UUID dea4593c-fa71-4579-88eb-51499faa7caf and name user.
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73079) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 14:36:02 user nova-compute[73079]: INFO nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] kernel doesn't support AMD SEV
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Libvirt baseline CPU <cpu>
Aug 17 14:36:02 user nova-compute[73079]:   <arch>x86_64</arch>
Aug 17 14:36:02 user nova-compute[73079]:   <model>Nehalem</model>
Aug 17 14:36:02 user nova-compute[73079]:   <vendor>Intel</vendor>
Aug 17 14:36:02 user nova-compute[73079]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 14:36:02 user nova-compute[73079]: </cpu>
Aug 17 14:36:02 user nova-compute[73079]:  {{(pid=73079) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Updated inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Updating resource provider dea4593c-fa71-4579-88eb-51499faa7caf generation from 0 to 1 during operation: update_inventory {{(pid=73079) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Updating resource provider dea4593c-fa71-4579-88eb-51499faa7caf generation from 1 to 2 during operation: update_traits {{(pid=73079) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.service [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Creating RPC server for service compute {{(pid=73079) start /opt/stack/nova/nova/service.py:182}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.service [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Join ServiceGroup membership for this service compute {{(pid=73079) start /opt/stack/nova/nova/service.py:199}}
Aug 17 14:36:02 user nova-compute[73079]: DEBUG nova.servicegroup.drivers.db [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73079) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 14:36:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:36:53 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:36:53 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=10332MB free_disk=26.238460540771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:36:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:37:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:37:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:37:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=10250MB free_disk=26.284034729003906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:37:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.096s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:38:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:38:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:38:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=10227MB free_disk=26.06871795654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:38:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:38:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:38:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:38:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:38:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:38:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:39:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:39:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:39:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=9511MB free_disk=26.091163635253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:39:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:39:57 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:39:57 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:39:57 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:39:57 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:39:57 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:39:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:39:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "a2c17473-d65d-4a2b-8382-ac868705c232" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:03 user nova-compute[73079]: INFO nova.compute.claims [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Claim successful on node user
Aug 17 14:40:03 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Creating image(s)
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "/opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "/opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.policy [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ae8ba1f04474c00be03b2d8ea745f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c83cb8ee234c77bf65a94c176b47b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:04 user nova-compute[73079]: INFO nova.compute.claims [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Claim successful on node user
Aug 17 14:40:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.part --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.virt.images [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] f1520146-7ad6-41ad-91e3-e68a652af0d4 was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.part /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.part /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.converted" returned: 0 in 0.343s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Creating image(s)
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "/opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "/opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "/opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.402s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:05 user nova-compute[73079]: INFO oslo.privsep.daemon [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6_9xyfa8/privsep.sock']
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.140s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:05 user sudo[82356]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6_9xyfa8/privsep.sock
Aug 17 14:40:05 user sudo[82356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 14:40:05 user nova-compute[73079]: DEBUG nova.policy [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ca8af258ca94a9dbfab07fb110fb813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eec98cb1ae342f08da74df4b2d76076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Successfully created port: dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:07 user nova-compute[73079]: INFO nova.compute.claims [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Claim successful on node user
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:07 user sudo[82356]: pam_unix(sudo:session): session closed for user root
Aug 17 14:40:07 user nova-compute[73079]: INFO oslo.privsep.daemon [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Spawned new privsep daemon via rootwrap
Aug 17 14:40:07 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 14:40:07 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 14:40:07 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 14:40:07 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82365
Aug 17 14:40:07 user nova-compute[73079]: WARNING oslo_privsep.priv_context [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] privsep daemon already running
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.158s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:07 user nova-compute[73079]: INFO nova.compute.claims [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Claim successful on node user
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.325s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:07 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.202s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk 1073741824" returned: 0 in 0.049s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.181s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:07 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Creating image(s)
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.208s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.policy [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58b4647e94614c84a7b0b77de3aa4e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7fcbaf2803041bc9a038147e2d03356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk 1073741824" returned: 0 in 0.061s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.038s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Cannot resize image /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lazy-loading 'migration_context' on Instance uuid a2c17473-d65d-4a2b-8382-ac868705c232 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:08 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Ensure instance console log exists: /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.380s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk 1073741824" returned: 0 in 0.063s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.449s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:08 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Creating image(s)
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Cannot resize image /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lazy-loading 'migration_context' on Instance uuid 48d1d41e-1443-498d-a54e-f7ce734e3089 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Successfully created port: 9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Ensure instance console log exists: /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.214s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG nova.policy [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '285ec6eef26e43ef82c9fb559594e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ba4161b12a4a238ecd22749dff64c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Cannot resize image /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'migration_context' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Ensure instance console log exists: /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk 1073741824" returned: 0 in 0.043s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Cannot resize image /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'migration_context' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Ensure instance console log exists: /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:11 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Successfully created port: 5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:11 user nova-compute[73079]: DEBUG nova.network.neutron [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Successfully updated port: dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:11 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Successfully created port: c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquired lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:11 user nova-compute[73079]: DEBUG nova.network.neutron [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.network.neutron [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Successfully updated port: 9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquired lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-changed-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Refreshing instance network info cache due to event network-changed-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] Acquiring lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-changed-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Refreshing instance network info cache due to event network-changed-9105402c-3986-4eea-b944-0ac652219a43. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] Acquiring lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.neutron [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updating instance_info_cache with network_info: [{"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updating instance_info_cache with network_info: [{"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Releasing lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Instance network_info: |[{"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Releasing lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Instance network_info: |[{"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] Acquired lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.neutron [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Refreshing network info cache for port dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Start _get_guest_xml network_info=[{"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] Acquired lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.neutron [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Refreshing network info cache for port 9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Start _get_guest_xml network_info=[{"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:13 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:13 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:13 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:13 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1861721010',display_name='tempest-ServersNegativeTestJSON-server-1861721010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1861721010',id=1,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40c83cb8ee234c77bf65a94c176b47b5',ramdisk_id='',reservation_id='r-efdcvdwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146357167',owner_user_name='tempest-ServersNegativeTestJSON-146357167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:04Z,user_data=None,user_id='8ae8ba1f04474c00be03b2d8ea745f97',uuid=a2c17473-d65d-4a2b-8382-ac868705c232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converting VIF {"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lazy-loading 'pci_devices' on Instance uuid a2c17473-d65d-4a2b-8382-ac868705c232 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2023844696',display_name='tempest-DeleteServersTestJSON-server-2023844696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2023844696',id=2,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eec98cb1ae342f08da74df4b2d76076',ramdisk_id='',reservation_id='r-gq56xt4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-723569045',owner_user_name='tempest-DeleteServersTestJSON-723569045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:05Z,user_data=None,user_id='3ca8af258ca94a9dbfab07fb110fb813',uuid=48d1d41e-1443-498d-a54e-f7ce734e3089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Converting VIF {"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lazy-loading 'pci_devices' on Instance uuid 48d1d41e-1443-498d-a54e-f7ce734e3089 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:13 user nova-compute[73079]:   <uuid>a2c17473-d65d-4a2b-8382-ac868705c232</uuid>
Aug 17 14:40:13 user nova-compute[73079]:   <name>instance-00000001</name>
Aug 17 14:40:13 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:13 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:13 user nova-compute[73079]:   <metadata>
Aug 17 14:40:13 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:13 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:name>tempest-ServersNegativeTestJSON-server-1861721010</nova:name>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:13</nova:creationTime>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:13 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:13 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:user uuid="8ae8ba1f04474c00be03b2d8ea745f97">tempest-ServersNegativeTestJSON-146357167-project-member</nova:user>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:project uuid="40c83cb8ee234c77bf65a94c176b47b5">tempest-ServersNegativeTestJSON-146357167</nova:project>
Aug 17 14:40:13 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:port uuid="dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5">
Aug 17 14:40:13 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 14:40:13 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:13 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:13 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:13 user nova-compute[73079]:   </metadata>
Aug 17 14:40:13 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:13 user nova-compute[73079]:     <system>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="serial">a2c17473-d65d-4a2b-8382-ac868705c232</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="uuid">a2c17473-d65d-4a2b-8382-ac868705c232</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:13 user nova-compute[73079]:     </system>
Aug 17 14:40:13 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:13 user nova-compute[73079]:   <os>
Aug 17 14:40:13 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:13 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:13 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:13 user nova-compute[73079]:   </os>
Aug 17 14:40:13 user nova-compute[73079]:   <features>
Aug 17 14:40:13 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:13 user nova-compute[73079]:     <apic/>
Aug 17 14:40:13 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:13 user nova-compute[73079]:   </features>
Aug 17 14:40:13 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:13 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:13 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:13 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:13 user nova-compute[73079]:   </clock>
Aug 17 14:40:13 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:13 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:13 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:13 user nova-compute[73079]:   </cpu>
Aug 17 14:40:13 user nova-compute[73079]:   <devices>
Aug 17 14:40:13 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:13 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:13 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk"/>
Aug 17 14:40:13 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:13 user nova-compute[73079]:     </disk>
Aug 17 14:40:13 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:13 user nova-compute[73079]:       <mac address="fa:16:3e:16:2d:32"/>
Aug 17 14:40:13 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:13 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:13 user nova-compute[73079]:       <target dev="tapdbe07d83-20"/>
Aug 17 14:40:13 user nova-compute[73079]:     </interface>
Aug 17 14:40:13 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:13 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/console.log" append="off"/>
Aug 17 14:40:13 user nova-compute[73079]:     </serial>
Aug 17 14:40:13 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:13 user nova-compute[73079]:     <video>
Aug 17 14:40:13 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:13 user nova-compute[73079]:     </video>
Aug 17 14:40:13 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:13 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:13 user nova-compute[73079]:     </rng>
Aug 17 14:40:13 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:13 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:13 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:13 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:13 user nova-compute[73079]:   </devices>
Aug 17 14:40:13 user nova-compute[73079]: </domain>
Aug 17 14:40:13 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1861721010',display_name='tempest-ServersNegativeTestJSON-server-1861721010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1861721010',id=1,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40c83cb8ee234c77bf65a94c176b47b5',ramdisk_id='',reservation_id='r-efdcvdwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146357167',owner_user_name='tempest-ServersNegativeTestJSON-146357167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:04Z,user_data=None,user_id='8ae8ba1f04474c00be03b2d8ea745f97',uuid=a2c17473-d65d-4a2b-8382-ac868705c232,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converting VIF {"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG os_vif [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Created schema index Interface.name {{(pid=73079) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Created schema index Port.name {{(pid=73079) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Created schema index Bridge.name {{(pid=73079) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:13 user nova-compute[73079]:   <uuid>48d1d41e-1443-498d-a54e-f7ce734e3089</uuid>
Aug 17 14:40:13 user nova-compute[73079]:   <name>instance-00000002</name>
Aug 17 14:40:13 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:13 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:13 user nova-compute[73079]:   <metadata>
Aug 17 14:40:13 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:13 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:name>tempest-DeleteServersTestJSON-server-2023844696</nova:name>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:13</nova:creationTime>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:13 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:13 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:user uuid="3ca8af258ca94a9dbfab07fb110fb813">tempest-DeleteServersTestJSON-723569045-project-member</nova:user>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:project uuid="0eec98cb1ae342f08da74df4b2d76076">tempest-DeleteServersTestJSON-723569045</nova:project>
Aug 17 14:40:13 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:13 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:13 user nova-compute[73079]:         <nova:port uuid="9105402c-3986-4eea-b944-0ac652219a43">
Aug 17 14:40:13 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 14:40:13 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:13 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:13 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:13 user nova-compute[73079]:   </metadata>
Aug 17 14:40:13 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:13 user nova-compute[73079]:     <system>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="serial">48d1d41e-1443-498d-a54e-f7ce734e3089</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="uuid">48d1d41e-1443-498d-a54e-f7ce734e3089</entry>
Aug 17 14:40:13 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:13 user nova-compute[73079]:     </system>
Aug 17 14:40:13 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:13 user nova-compute[73079]:   <os>
Aug 17 14:40:13 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:13 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:13 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:13 user nova-compute[73079]:   </os>
Aug 17 14:40:13 user nova-compute[73079]:   <features>
Aug 17 14:40:13 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:13 user nova-compute[73079]:     <apic/>
Aug 17 14:40:13 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:13 user nova-compute[73079]:   </features>
Aug 17 14:40:13 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:13 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:13 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:13 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:13 user nova-compute[73079]:   </clock>
Aug 17 14:40:13 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:13 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:13 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:13 user nova-compute[73079]:   </cpu>
Aug 17 14:40:13 user nova-compute[73079]:   <devices>
Aug 17 14:40:13 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:13 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:13 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk"/>
Aug 17 14:40:13 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:13 user nova-compute[73079]:     </disk>
Aug 17 14:40:13 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:13 user nova-compute[73079]:       <mac address="fa:16:3e:39:0e:06"/>
Aug 17 14:40:13 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:13 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:13 user nova-compute[73079]:       <target dev="tap9105402c-39"/>
Aug 17 14:40:13 user nova-compute[73079]:     </interface>
Aug 17 14:40:13 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:13 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/console.log" append="off"/>
Aug 17 14:40:13 user nova-compute[73079]:     </serial>
Aug 17 14:40:13 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:13 user nova-compute[73079]:     <video>
Aug 17 14:40:13 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:13 user nova-compute[73079]:     </video>
Aug 17 14:40:13 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:13 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:13 user nova-compute[73079]:     </rng>
Aug 17 14:40:13 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:13 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:13 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:13 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:13 user nova-compute[73079]:   </devices>
Aug 17 14:40:13 user nova-compute[73079]: </domain>
Aug 17 14:40:13 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2023844696',display_name='tempest-DeleteServersTestJSON-server-2023844696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2023844696',id=2,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eec98cb1ae342f08da74df4b2d76076',ramdisk_id='',reservation_id='r-gq56xt4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-723569045',owner_user_name='tempest-DeleteServersTestJSON-723569045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:05Z,user_data=None,user_id='3ca8af258ca94a9dbfab07fb110fb813',uuid=48d1d41e-1443-498d-a54e-f7ce734e3089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Converting VIF {"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG os_vif [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [POLLIN] on fd 26 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] tcp:127.0.0.1:6640: entering BACKOFF {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] schema index <ovs.db.idl.IdlTable object at 0x7f27e84b2200>.name already exists {{(pid=73079) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] schema index <ovs.db.idl.IdlTable object at 0x7f27e84bed40>.name already exists {{(pid=73079) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] schema index <ovs.db.idl.IdlTable object at 0x7f27e847c760>.name already exists {{(pid=73079) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [POLLOUT] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:13 user nova-compute[73079]: INFO oslo.privsep.daemon [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpvau948z4/privsep.sock']
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:13 user sudo[82438]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpvau948z4/privsep.sock
Aug 17 14:40:13 user sudo[82438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:13 user nova-compute[73079]: INFO nova.compute.claims [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Claim successful on node user
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Creating image(s)
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Successfully updated port: c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.policy [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e233ac54eb804ff0b6fdbf986a70dfe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3052ad0ca90d483284dd52edd3a79fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updated VIF entry in instance network info cache for port 9105402c-3986-4eea-b944-0ac652219a43. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updating instance_info_cache with network_info: [{"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cb5052a2-84e7-49d2-b18a-f68a80e0350e req-63d66afa-616c-4ee6-9872-522e523e19f9 service nova] Releasing lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Successfully updated port: 5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.235s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing instance network info cache due to event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-changed-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Refreshing instance network info cache due to event network-changed-5955a467-f321-452d-812d-4796e5b7d6df. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.239s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk 1073741824" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.229s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Cannot resize image /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.objects.instance [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'migration_context' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Ensure instance console log exists: /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.network.neutron [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updated VIF entry in instance network info cache for port dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.network.neutron [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updating instance_info_cache with network_info: [{"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-071f069e-76f1-46e8-87c8-620cbb8a401c req-9587141c-ac90-4b3d-bc53-d0f08124ef28 service nova] Releasing lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:15 user sudo[82438]: pam_unix(sudo:session): session closed for user root
Aug 17 14:40:15 user nova-compute[73079]: INFO oslo.privsep.daemon [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Spawned new privsep daemon via rootwrap
Aug 17 14:40:15 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 14:40:15 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 14:40:15 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 14:40:15 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82454
Aug 17 14:40:15 user nova-compute[73079]: WARNING oslo_privsep.priv_context [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] privsep daemon already running
Aug 17 14:40:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance network_info: |[{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.network.neutron [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Refreshing network info cache for port 5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start _get_guest_xml network_info=[{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:16 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:16 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:16 user nova-compute[73079]:   <uuid>9d2c4290-ec0a-4dc3-8afa-552487ac923f</uuid>
Aug 17 14:40:16 user nova-compute[73079]:   <name>instance-00000003</name>
Aug 17 14:40:16 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:16 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:16 user nova-compute[73079]:   <metadata>
Aug 17 14:40:16 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:16 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherB-server-1550667638</nova:name>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:16</nova:creationTime>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:16 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:16 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:user uuid="58b4647e94614c84a7b0b77de3aa4e03">tempest-ServerActionsTestOtherB-1211659744-project-member</nova:user>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:project uuid="a7fcbaf2803041bc9a038147e2d03356">tempest-ServerActionsTestOtherB-1211659744</nova:project>
Aug 17 14:40:16 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:port uuid="5955a467-f321-452d-812d-4796e5b7d6df">
Aug 17 14:40:16 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:40:16 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:16 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:16 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:16 user nova-compute[73079]:   </metadata>
Aug 17 14:40:16 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:16 user nova-compute[73079]:     <system>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="serial">9d2c4290-ec0a-4dc3-8afa-552487ac923f</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="uuid">9d2c4290-ec0a-4dc3-8afa-552487ac923f</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:16 user nova-compute[73079]:     </system>
Aug 17 14:40:16 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:16 user nova-compute[73079]:   <os>
Aug 17 14:40:16 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:16 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:16 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:16 user nova-compute[73079]:   </os>
Aug 17 14:40:16 user nova-compute[73079]:   <features>
Aug 17 14:40:16 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:16 user nova-compute[73079]:     <apic/>
Aug 17 14:40:16 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:16 user nova-compute[73079]:   </features>
Aug 17 14:40:16 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:16 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:16 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:16 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:16 user nova-compute[73079]:   </clock>
Aug 17 14:40:16 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:16 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:16 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:16 user nova-compute[73079]:   </cpu>
Aug 17 14:40:16 user nova-compute[73079]:   <devices>
Aug 17 14:40:16 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:16 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:16 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk"/>
Aug 17 14:40:16 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:16 user nova-compute[73079]:     </disk>
Aug 17 14:40:16 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:16 user nova-compute[73079]:       <mac address="fa:16:3e:34:d7:35"/>
Aug 17 14:40:16 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:16 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:16 user nova-compute[73079]:       <target dev="tap5955a467-f3"/>
Aug 17 14:40:16 user nova-compute[73079]:     </interface>
Aug 17 14:40:16 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:16 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/console.log" append="off"/>
Aug 17 14:40:16 user nova-compute[73079]:     </serial>
Aug 17 14:40:16 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:16 user nova-compute[73079]:     <video>
Aug 17 14:40:16 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:16 user nova-compute[73079]:     </video>
Aug 17 14:40:16 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:16 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:16 user nova-compute[73079]:     </rng>
Aug 17 14:40:16 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:16 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:16 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:16 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:16 user nova-compute[73079]:   </devices>
Aug 17 14:40:16 user nova-compute[73079]: </domain>
Aug 17 14:40:16 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG os_vif [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance network_info: |[{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Start _get_guest_xml network_info=[{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:16 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:16 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbe07d83-20, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbe07d83-20, col_values=(('external_ids', {'iface-id': 'dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:2d:32', 'vm-uuid': 'a2c17473-d65d-4a2b-8382-ac868705c232'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:16 user nova-compute[73079]: INFO os_vif [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20')
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9105402c-39, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9105402c-39, col_values=(('external_ids', {'iface-id': '9105402c-3986-4eea-b944-0ac652219a43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:0e:06', 'vm-uuid': '48d1d41e-1443-498d-a54e-f7ce734e3089'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1518138782',display_name='tempest-ServerStableDeviceRescueTest-server-1518138782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1518138782',id=4,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsAjCIc/WwAiAI8Pzwwt/hC03akqhW8QrVflG2svRsETTn8bw3n5V1LOPK7odRcM4K6pl/+pi/eRmipG6h+fDbLKiqHSrOsDumuGA6bSQbmWMlWwULwwhp9wtA9pedt2w==',key_name='tempest-keypair-41245435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ba4161b12a4a238ecd22749dff64c4',ramdisk_id='',reservation_id='r-c84flbdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1672943422',owner_user_name='tempest-ServerStableDeviceRescueTest-1672943422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285ec6eef26e43ef82c9fb559594e1be',uuid=02f2d969-22f4-4785-a5e2-c805d45256b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converting VIF {"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'pci_devices' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: INFO os_vif [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39')
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5955a467-f3, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5955a467-f3, col_values=(('external_ids', {'iface-id': '5955a467-f321-452d-812d-4796e5b7d6df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:d7:35', 'vm-uuid': '9d2c4290-ec0a-4dc3-8afa-552487ac923f'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:16 user nova-compute[73079]:   <uuid>02f2d969-22f4-4785-a5e2-c805d45256b3</uuid>
Aug 17 14:40:16 user nova-compute[73079]:   <name>instance-00000004</name>
Aug 17 14:40:16 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:16 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:16 user nova-compute[73079]:   <metadata>
Aug 17 14:40:16 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:16 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1518138782</nova:name>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:16</nova:creationTime>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:16 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:16 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:user uuid="285ec6eef26e43ef82c9fb559594e1be">tempest-ServerStableDeviceRescueTest-1672943422-project-member</nova:user>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:project uuid="c7ba4161b12a4a238ecd22749dff64c4">tempest-ServerStableDeviceRescueTest-1672943422</nova:project>
Aug 17 14:40:16 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:16 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:16 user nova-compute[73079]:         <nova:port uuid="c19575ab-dfc7-4e70-ac23-4a37a0044152">
Aug 17 14:40:16 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 14:40:16 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:16 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:16 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:16 user nova-compute[73079]:   </metadata>
Aug 17 14:40:16 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:16 user nova-compute[73079]:     <system>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="serial">02f2d969-22f4-4785-a5e2-c805d45256b3</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="uuid">02f2d969-22f4-4785-a5e2-c805d45256b3</entry>
Aug 17 14:40:16 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:16 user nova-compute[73079]:     </system>
Aug 17 14:40:16 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:16 user nova-compute[73079]:   <os>
Aug 17 14:40:16 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:16 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:16 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:16 user nova-compute[73079]:   </os>
Aug 17 14:40:16 user nova-compute[73079]:   <features>
Aug 17 14:40:16 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:16 user nova-compute[73079]:     <apic/>
Aug 17 14:40:16 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:16 user nova-compute[73079]:   </features>
Aug 17 14:40:16 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:16 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:16 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:16 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:16 user nova-compute[73079]:   </clock>
Aug 17 14:40:16 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:16 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:16 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:16 user nova-compute[73079]:   </cpu>
Aug 17 14:40:16 user nova-compute[73079]:   <devices>
Aug 17 14:40:16 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:16 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:16 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk"/>
Aug 17 14:40:16 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:16 user nova-compute[73079]:     </disk>
Aug 17 14:40:16 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:16 user nova-compute[73079]:       <mac address="fa:16:3e:c5:62:0d"/>
Aug 17 14:40:16 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:16 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:16 user nova-compute[73079]:       <target dev="tapc19575ab-df"/>
Aug 17 14:40:16 user nova-compute[73079]:     </interface>
Aug 17 14:40:16 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:16 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/console.log" append="off"/>
Aug 17 14:40:16 user nova-compute[73079]:     </serial>
Aug 17 14:40:16 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:16 user nova-compute[73079]:     <video>
Aug 17 14:40:16 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:16 user nova-compute[73079]:     </video>
Aug 17 14:40:16 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:16 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:16 user nova-compute[73079]:     </rng>
Aug 17 14:40:16 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:16 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:16 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:16 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:16 user nova-compute[73079]:   </devices>
Aug 17 14:40:16 user nova-compute[73079]: </domain>
Aug 17 14:40:16 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1518138782',display_name='tempest-ServerStableDeviceRescueTest-server-1518138782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1518138782',id=4,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsAjCIc/WwAiAI8Pzwwt/hC03akqhW8QrVflG2svRsETTn8bw3n5V1LOPK7odRcM4K6pl/+pi/eRmipG6h+fDbLKiqHSrOsDumuGA6bSQbmWMlWwULwwhp9wtA9pedt2w==',key_name='tempest-keypair-41245435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7ba4161b12a4a238ecd22749dff64c4',ramdisk_id='',reservation_id='r-c84flbdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1672943422',owner_user_name='tempest-ServerStableDeviceRescueTest-1672943422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285ec6eef26e43ef82c9fb559594e1be',uuid=02f2d969-22f4-4785-a5e2-c805d45256b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converting VIF {"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG os_vif [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: INFO os_vif [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3')
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc19575ab-df, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc19575ab-df, col_values=(('external_ids', {'iface-id': 'c19575ab-dfc7-4e70-ac23-4a37a0044152', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:62:0d', 'vm-uuid': '02f2d969-22f4-4785-a5e2-c805d45256b3'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] No VIF found with MAC fa:16:3e:16:2d:32, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:16 user nova-compute[73079]: INFO os_vif [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df')
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] No VIF found with MAC fa:16:3e:39:0e:06, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No VIF found with MAC fa:16:3e:34:d7:35, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No VIF found with MAC fa:16:3e:c5:62:0d, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:16 user nova-compute[73079]: DEBUG nova.network.neutron [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Successfully created port: 88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updated VIF entry in instance network info cache for port 5955a467-f321-452d-812d-4796e5b7d6df. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3b867aeb-3053-4157-b5bd-737347a3cb80 req-e1611932-3ae2-4e0c-85de-b1009d488795 service nova] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updated VIF entry in instance network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2096382-63af-42ad-b143-6880ebf86463 req-19c6fc70-ecb7-4fa0-a671-a04510d9f2aa service nova] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Successfully updated port: 88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-changed-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Refreshing instance network info cache due to event network-changed-88abdc44-4987-4e42-aac5-80b85b07fa9e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance network_info: |[{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Refreshing network info cache for port 88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start _get_guest_xml network_info=[{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.objects.instance [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'pci_devices' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:20 user nova-compute[73079]:   <uuid>259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</uuid>
Aug 17 14:40:20 user nova-compute[73079]:   <name>instance-00000005</name>
Aug 17 14:40:20 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:20 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:20 user nova-compute[73079]:   <metadata>
Aug 17 14:40:20 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:20 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:20 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeTestJSON-server-433840162</nova:name>
Aug 17 14:40:20 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:20</nova:creationTime>
Aug 17 14:40:20 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:20 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:20 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:20 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:user uuid="e233ac54eb804ff0b6fdbf986a70dfe8">tempest-AttachVolumeTestJSON-831896009-project-member</nova:user>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:project uuid="3052ad0ca90d483284dd52edd3a79fbe">tempest-AttachVolumeTestJSON-831896009</nova:project>
Aug 17 14:40:20 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:20 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:20 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:20 user nova-compute[73079]:         <nova:port uuid="88abdc44-4987-4e42-aac5-80b85b07fa9e">
Aug 17 14:40:20 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 14:40:20 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:20 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:20 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:20 user nova-compute[73079]:   </metadata>
Aug 17 14:40:20 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:20 user nova-compute[73079]:     <system>
Aug 17 14:40:20 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:20 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:20 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:20 user nova-compute[73079]:       <entry name="serial">259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</entry>
Aug 17 14:40:20 user nova-compute[73079]:       <entry name="uuid">259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</entry>
Aug 17 14:40:20 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:20 user nova-compute[73079]:     </system>
Aug 17 14:40:20 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:20 user nova-compute[73079]:   <os>
Aug 17 14:40:20 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:20 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:20 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:20 user nova-compute[73079]:   </os>
Aug 17 14:40:20 user nova-compute[73079]:   <features>
Aug 17 14:40:20 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:20 user nova-compute[73079]:     <apic/>
Aug 17 14:40:20 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:20 user nova-compute[73079]:   </features>
Aug 17 14:40:20 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:20 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:20 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:20 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:20 user nova-compute[73079]:   </clock>
Aug 17 14:40:20 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:20 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:20 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:20 user nova-compute[73079]:   </cpu>
Aug 17 14:40:20 user nova-compute[73079]:   <devices>
Aug 17 14:40:20 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:20 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:20 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk"/>
Aug 17 14:40:20 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:20 user nova-compute[73079]:     </disk>
Aug 17 14:40:20 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:20 user nova-compute[73079]:       <mac address="fa:16:3e:44:20:b7"/>
Aug 17 14:40:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:20 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:20 user nova-compute[73079]:       <target dev="tap88abdc44-49"/>
Aug 17 14:40:20 user nova-compute[73079]:     </interface>
Aug 17 14:40:20 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:20 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/console.log" append="off"/>
Aug 17 14:40:20 user nova-compute[73079]:     </serial>
Aug 17 14:40:20 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:20 user nova-compute[73079]:     <video>
Aug 17 14:40:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:20 user nova-compute[73079]:     </video>
Aug 17 14:40:20 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:20 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:20 user nova-compute[73079]:     </rng>
Aug 17 14:40:20 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:20 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:20 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:20 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:20 user nova-compute[73079]:   </devices>
Aug 17 14:40:20 user nova-compute[73079]: </domain>
Aug 17 14:40:20 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG os_vif [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88abdc44-49, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88abdc44-49, col_values=(('external_ids', {'iface-id': '88abdc44-4987-4e42-aac5-80b85b07fa9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:20:b7', 'vm-uuid': '259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:20 user nova-compute[73079]: INFO os_vif [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49')
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No VIF found with MAC fa:16:3e:44:20:b7, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updated VIF entry in instance network info cache for port 88abdc44-4987-4e42-aac5-80b85b07fa9e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-98ac3ccd-b751-4a68-b7fe-34696c2c3442 req-72728a9e-159c-44c4-83c8-83df4687d61b service nova] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-23e4b747-d437-4999-b965-05d9ec6a697f req-da47b300-1bc9-4c64-8112-9cf19ac6d710 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-23e4b747-d437-4999-b965-05d9ec6a697f req-da47b300-1bc9-4c64-8112-9cf19ac6d710 service nova] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-23e4b747-d437-4999-b965-05d9ec6a697f req-da47b300-1bc9-4c64-8112-9cf19ac6d710 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-23e4b747-d437-4999-b965-05d9ec6a697f req-da47b300-1bc9-4c64-8112-9cf19ac6d710 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-23e4b747-d437-4999-b965-05d9ec6a697f req-da47b300-1bc9-4c64-8112-9cf19ac6d710 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] No waiting events found dispatching network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:23 user nova-compute[73079]: WARNING nova.compute.manager [req-23e4b747-d437-4999-b965-05d9ec6a697f req-da47b300-1bc9-4c64-8112-9cf19ac6d710 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received unexpected event network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 for instance with vm_state building and task_state spawning.
Aug 17 14:40:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] No waiting events found dispatching network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:25 user nova-compute[73079]: WARNING nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received unexpected event network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 for instance with vm_state building and task_state spawning.
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:25 user nova-compute[73079]: WARNING nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state building and task_state spawning.
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:25 user nova-compute[73079]: WARNING nova.compute.manager [req-e14c1cca-e1ba-43c9-8b04-48a84b49c248 req-3b6a164b-06fa-401e-bdec-226fa2c679d8 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state building and task_state spawning.
Aug 17 14:40:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283226.104006, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Resumed (Lifecycle Event)
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.claims [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Claim successful on node user
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance spawned successfully.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Instance spawned successfully.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283226.121246, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Started (Lifecycle Event)
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Took 20.90 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Took 17.68 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283226.1227107, 48d1d41e-1443-498d-a54e-f7ce734e3089 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] VM Resumed (Lifecycle Event)
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Took 19.25 seconds to build instance.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2e669274-7828-47e9-b015-24c9b65daff3 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.418s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Took 22.30 seconds to build instance.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283226.1228268, 48d1d41e-1443-498d-a54e-f7ce734e3089 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] VM Started (Lifecycle Event)
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e375d808-3ba6-4e22-9b77-e375075e841a tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.437s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283226.7521446, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Resumed (Lifecycle Event)
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance spawned successfully.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.486s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283226.7539773, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Started (Lifecycle Event)
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Took 19.02 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283227.090687, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Resumed (Lifecycle Event)
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.policy [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0e2a779916a4463a819fa223bb0af42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3cf39349f140cb962abc3857c8b7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Took 20.08 seconds to build instance.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a69db5d2-3459-4222-8986-17326cf8300e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.279s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance spawned successfully.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Instance spawned successfully.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.claims [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Claim successful on node user
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283227.0912182, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Started (Lifecycle Event)
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283227.1128743, a2c17473-d65d-4a2b-8382-ac868705c232 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] VM Resumed (Lifecycle Event)
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Took 12.87 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Creating image(s)
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "/opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "/opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "/opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283227.1253994, a2c17473-d65d-4a2b-8382-ac868705c232 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] VM Started (Lifecycle Event)
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Took 23.47 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Took 13.92 seconds to build instance.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87a9b3d6-62f1-4e2a-a740-93de94b16190 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.141s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.233s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:27 user nova-compute[73079]: INFO nova.compute.manager [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Took 24.40 seconds to build instance.
Aug 17 14:40:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5136e2ed-1d2b-4f34-b7bd-4688850470ee tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "a2c17473-d65d-4a2b-8382-ac868705c232" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.584s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.267s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk 1073741824" returned: 0 in 0.244s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.519s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.191s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Successfully created port: 88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.247s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.policy [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b3396b0c854e4aa6ab6fef1874793d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9587f77ba47d4d02b3a8068289959ec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Creating image(s)
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "/opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "/opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "/opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "7fc735c9b9956c914be3b1b6685757f4698929c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "7fc735c9b9956c914be3b1b6685757f4698929c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Cannot resize image /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'migration_context' on Instance uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Ensure instance console log exists: /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.part --force-share --output=json" returned: 0 in 0.275s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:29 user nova-compute[73079]: DEBUG nova.virt.images [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] b6ed9d48-cb7b-411b-8805-d089c2e0efec was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 14:40:29 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:40:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.part /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.part /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.converted" returned: 0 in 0.405s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Successfully updated port: 88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquired lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-changed-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Refreshing instance network info cache due to event network-changed-88d49d09-b3cc-4344-afc5-e4055c2c9a8e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] Acquiring lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Successfully created port: 2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8.converted --force-share --output=json" returned: 0 in 0.399s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "7fc735c9b9956c914be3b1b6685757f4698929c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.961s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8 --force-share --output=json" returned: 0 in 0.325s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "7fc735c9b9956c914be3b1b6685757f4698929c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "7fc735c9b9956c914be3b1b6685757f4698929c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updating instance_info_cache with network_info: [{"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8 --force-share --output=json" returned: 0 in 0.374s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Releasing lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Instance network_info: |[{"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8,backing_fmt=raw /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] Acquired lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.network.neutron [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Refreshing network info cache for port 88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Start _get_guest_xml network_info=[{"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8,backing_fmt=raw /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk 1073741824" returned: 0 in 0.085s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "7fc735c9b9956c914be3b1b6685757f4698929c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.474s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:31 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:31 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-586977430',display_name='tempest-VolumesAdminNegativeTest-server-586977430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-586977430',id=6,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn7UzapkwUx5QrPxoGiR89m+1DEW9Ke9qQHGQe9cHwqqaVdJuNIrFRodYtbW6Je3eRNKAs/cSorXZNlPRiCKxesA/HfK0cNTyufqRL5lQXZRzGVr/VNJ9IFvjUud+mMhg==',key_name='tempest-keypair-698818835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3cf39349f140cb962abc3857c8b7c0',ramdisk_id='',reservation_id='r-gveqbshp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-385938588',owner_user_name='tempest-VolumesAdminNegativeTest-385938588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0e2a779916a4463a819fa223bb0af42',uuid=a279bc96-247f-43e4-9d99-3dc690da4d0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converting VIF {"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'pci_devices' on Instance uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:31 user nova-compute[73079]:   <uuid>a279bc96-247f-43e4-9d99-3dc690da4d0a</uuid>
Aug 17 14:40:31 user nova-compute[73079]:   <name>instance-00000006</name>
Aug 17 14:40:31 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:31 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:31 user nova-compute[73079]:   <metadata>
Aug 17 14:40:31 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:31 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:31 user nova-compute[73079]:       <nova:name>tempest-VolumesAdminNegativeTest-server-586977430</nova:name>
Aug 17 14:40:31 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:31</nova:creationTime>
Aug 17 14:40:31 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:31 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:31 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:31 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:user uuid="a0e2a779916a4463a819fa223bb0af42">tempest-VolumesAdminNegativeTest-385938588-project-member</nova:user>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:project uuid="fd3cf39349f140cb962abc3857c8b7c0">tempest-VolumesAdminNegativeTest-385938588</nova:project>
Aug 17 14:40:31 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:31 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:31 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:31 user nova-compute[73079]:         <nova:port uuid="88d49d09-b3cc-4344-afc5-e4055c2c9a8e">
Aug 17 14:40:31 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 14:40:31 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:31 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:31 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:31 user nova-compute[73079]:   </metadata>
Aug 17 14:40:31 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:31 user nova-compute[73079]:     <system>
Aug 17 14:40:31 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:31 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:31 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:31 user nova-compute[73079]:       <entry name="serial">a279bc96-247f-43e4-9d99-3dc690da4d0a</entry>
Aug 17 14:40:31 user nova-compute[73079]:       <entry name="uuid">a279bc96-247f-43e4-9d99-3dc690da4d0a</entry>
Aug 17 14:40:31 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:31 user nova-compute[73079]:     </system>
Aug 17 14:40:31 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:31 user nova-compute[73079]:   <os>
Aug 17 14:40:31 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:31 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:31 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:31 user nova-compute[73079]:   </os>
Aug 17 14:40:31 user nova-compute[73079]:   <features>
Aug 17 14:40:31 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:31 user nova-compute[73079]:     <apic/>
Aug 17 14:40:31 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:31 user nova-compute[73079]:   </features>
Aug 17 14:40:31 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:31 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:31 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:31 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:31 user nova-compute[73079]:   </clock>
Aug 17 14:40:31 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:31 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:31 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:31 user nova-compute[73079]:   </cpu>
Aug 17 14:40:31 user nova-compute[73079]:   <devices>
Aug 17 14:40:31 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:31 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:31 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk"/>
Aug 17 14:40:31 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:31 user nova-compute[73079]:     </disk>
Aug 17 14:40:31 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:31 user nova-compute[73079]:       <mac address="fa:16:3e:62:d3:d3"/>
Aug 17 14:40:31 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:31 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:31 user nova-compute[73079]:       <target dev="tap88d49d09-b3"/>
Aug 17 14:40:31 user nova-compute[73079]:     </interface>
Aug 17 14:40:31 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:31 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/console.log" append="off"/>
Aug 17 14:40:31 user nova-compute[73079]:     </serial>
Aug 17 14:40:31 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:31 user nova-compute[73079]:     <video>
Aug 17 14:40:31 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:31 user nova-compute[73079]:     </video>
Aug 17 14:40:31 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:31 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:31 user nova-compute[73079]:     </rng>
Aug 17 14:40:31 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:31 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:31 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:31 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:31 user nova-compute[73079]:   </devices>
Aug 17 14:40:31 user nova-compute[73079]: </domain>
Aug 17 14:40:31 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-586977430',display_name='tempest-VolumesAdminNegativeTest-server-586977430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-586977430',id=6,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn7UzapkwUx5QrPxoGiR89m+1DEW9Ke9qQHGQe9cHwqqaVdJuNIrFRodYtbW6Je3eRNKAs/cSorXZNlPRiCKxesA/HfK0cNTyufqRL5lQXZRzGVr/VNJ9IFvjUud+mMhg==',key_name='tempest-keypair-698818835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3cf39349f140cb962abc3857c8b7c0',ramdisk_id='',reservation_id='r-gveqbshp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-385938588',owner_user_name='tempest-VolumesAdminNegativeTest-385938588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0e2a779916a4463a819fa223bb0af42',uuid=a279bc96-247f-43e4-9d99-3dc690da4d0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converting VIF {"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG os_vif [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88d49d09-b3, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88d49d09-b3, col_values=(('external_ids', {'iface-id': '88d49d09-b3cc-4344-afc5-e4055c2c9a8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:d3:d3', 'vm-uuid': 'a279bc96-247f-43e4-9d99-3dc690da4d0a'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:31 user nova-compute[73079]: INFO os_vif [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3')
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No VIF found with MAC fa:16:3e:62:d3:d3, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8 --force-share --output=json" returned: 0 in 0.482s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Successfully updated port: 2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquired lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-changed-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Refreshing instance network info cache due to event network-changed-2fc84308-85e4-4b78-95f6-4a9df66f466a. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] Acquiring lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Cannot resize image /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lazy-loading 'migration_context' on Instance uuid 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Ensure instance console log exists: /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updating instance_info_cache with network_info: [{"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Releasing lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Instance network_info: |[{"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] Acquired lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Refreshing network info cache for port 2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Start _get_guest_xml network_info=[{"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:40:19Z,direct_url=<?>,disk_format='qcow2',id=b6ed9d48-cb7b-411b-8805-d089c2e0efec,min_disk=0,min_ram=0,name='',owner='feb0eda4021c434cb06919d7f8874147',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:40:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'image_id': 'b6ed9d48-cb7b-411b-8805-d089c2e0efec'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:33 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:33 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:40:19Z,direct_url=<?>,disk_format='qcow2',id=b6ed9d48-cb7b-411b-8805-d089c2e0efec,min_disk=0,min_ram=0,name='',owner='feb0eda4021c434cb06919d7f8874147',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:40:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1186106875',display_name='tempest-AttachSCSIVolumeTestJSON-server-1186106875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1186106875',id=7,image_ref='b6ed9d48-cb7b-411b-8805-d089c2e0efec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAMRPfSLUW4YfmgK1Vx60/b+5O89azLeohdN0AwXrrECUbkfWGN4A0pYuWp8l/N6oa/m4VRTj2RG33Lmw9mUgasPg+L43bPFlk2ojrVNFOhuZlklU7mH3hOgBcxhPnCsw==',key_name='tempest-keypair-1640666655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9587f77ba47d4d02b3a8068289959ec1',ramdisk_id='',reservation_id='r-fk6si0tz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b6ed9d48-cb7b-411b-8805-d089c2e0efec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-87643929',owner_user_name='tempest-AttachSCSIVolumeTestJSON-87643929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3396b0c854e4aa6ab6fef1874793d',uuid=04afdcd0-4876-4227-84f6-b2dcf8e041f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Converting VIF {"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lazy-loading 'pci_devices' on Instance uuid 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:33 user nova-compute[73079]:   <uuid>04afdcd0-4876-4227-84f6-b2dcf8e041f4</uuid>
Aug 17 14:40:33 user nova-compute[73079]:   <name>instance-00000007</name>
Aug 17 14:40:33 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:33 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:33 user nova-compute[73079]:   <metadata>
Aug 17 14:40:33 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:33 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:33 user nova-compute[73079]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1186106875</nova:name>
Aug 17 14:40:33 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:33</nova:creationTime>
Aug 17 14:40:33 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:33 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:33 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:33 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:user uuid="06b3396b0c854e4aa6ab6fef1874793d">tempest-AttachSCSIVolumeTestJSON-87643929-project-member</nova:user>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:project uuid="9587f77ba47d4d02b3a8068289959ec1">tempest-AttachSCSIVolumeTestJSON-87643929</nova:project>
Aug 17 14:40:33 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:33 user nova-compute[73079]:       <nova:root type="image" uuid="b6ed9d48-cb7b-411b-8805-d089c2e0efec"/>
Aug 17 14:40:33 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:33 user nova-compute[73079]:         <nova:port uuid="2fc84308-85e4-4b78-95f6-4a9df66f466a">
Aug 17 14:40:33 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 14:40:33 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:33 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:33 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:33 user nova-compute[73079]:   </metadata>
Aug 17 14:40:33 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:33 user nova-compute[73079]:     <system>
Aug 17 14:40:33 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:33 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:33 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:33 user nova-compute[73079]:       <entry name="serial">04afdcd0-4876-4227-84f6-b2dcf8e041f4</entry>
Aug 17 14:40:33 user nova-compute[73079]:       <entry name="uuid">04afdcd0-4876-4227-84f6-b2dcf8e041f4</entry>
Aug 17 14:40:33 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:33 user nova-compute[73079]:     </system>
Aug 17 14:40:33 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:33 user nova-compute[73079]:   <os>
Aug 17 14:40:33 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:33 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:33 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:33 user nova-compute[73079]:   </os>
Aug 17 14:40:33 user nova-compute[73079]:   <features>
Aug 17 14:40:33 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:33 user nova-compute[73079]:     <apic/>
Aug 17 14:40:33 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:33 user nova-compute[73079]:   </features>
Aug 17 14:40:33 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:33 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:33 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:33 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:33 user nova-compute[73079]:   </clock>
Aug 17 14:40:33 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:33 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:33 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:33 user nova-compute[73079]:   </cpu>
Aug 17 14:40:33 user nova-compute[73079]:   <devices>
Aug 17 14:40:33 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:33 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:33 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk"/>
Aug 17 14:40:33 user nova-compute[73079]:       <target dev="sda" bus="scsi"/>
Aug 17 14:40:33 user nova-compute[73079]:       <address type="drive" controller="0" unit="0"/>
Aug 17 14:40:33 user nova-compute[73079]:     </disk>
Aug 17 14:40:33 user nova-compute[73079]:     <disk type="file" device="cdrom">
Aug 17 14:40:33 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 14:40:33 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.config"/>
Aug 17 14:40:33 user nova-compute[73079]:       <target dev="sdb" bus="scsi"/>
Aug 17 14:40:33 user nova-compute[73079]:       <address type="drive" controller="0" unit="1"/>
Aug 17 14:40:33 user nova-compute[73079]:     </disk>
Aug 17 14:40:33 user nova-compute[73079]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 14:40:33 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:33 user nova-compute[73079]:       <mac address="fa:16:3e:0c:c1:1f"/>
Aug 17 14:40:33 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:33 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:33 user nova-compute[73079]:       <target dev="tap2fc84308-85"/>
Aug 17 14:40:33 user nova-compute[73079]:     </interface>
Aug 17 14:40:33 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:33 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/console.log" append="off"/>
Aug 17 14:40:33 user nova-compute[73079]:     </serial>
Aug 17 14:40:33 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:33 user nova-compute[73079]:     <video>
Aug 17 14:40:33 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:33 user nova-compute[73079]:     </video>
Aug 17 14:40:33 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:33 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:33 user nova-compute[73079]:     </rng>
Aug 17 14:40:33 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:33 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:33 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:33 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:33 user nova-compute[73079]:   </devices>
Aug 17 14:40:33 user nova-compute[73079]: </domain>
Aug 17 14:40:33 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1186106875',display_name='tempest-AttachSCSIVolumeTestJSON-server-1186106875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1186106875',id=7,image_ref='b6ed9d48-cb7b-411b-8805-d089c2e0efec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAMRPfSLUW4YfmgK1Vx60/b+5O89azLeohdN0AwXrrECUbkfWGN4A0pYuWp8l/N6oa/m4VRTj2RG33Lmw9mUgasPg+L43bPFlk2ojrVNFOhuZlklU7mH3hOgBcxhPnCsw==',key_name='tempest-keypair-1640666655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9587f77ba47d4d02b3a8068289959ec1',ramdisk_id='',reservation_id='r-fk6si0tz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b6ed9d48-cb7b-411b-8805-d089c2e0efec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-87643929',owner_user_name='tempest-AttachSCSIVolumeTestJSON-87643929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3396b0c854e4aa6ab6fef1874793d',uuid=04afdcd0-4876-4227-84f6-b2dcf8e041f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Converting VIF {"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG os_vif [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fc84308-85, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fc84308-85, col_values=(('external_ids', {'iface-id': '2fc84308-85e4-4b78-95f6-4a9df66f466a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:c1:1f', 'vm-uuid': '04afdcd0-4876-4227-84f6-b2dcf8e041f4'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updated VIF entry in instance network info cache for port 88d49d09-b3cc-4344-afc5-e4055c2c9a8e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updating instance_info_cache with network_info: [{"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: INFO os_vif [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85')
Aug 17 14:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-10e86f78-eda5-4b14-9f09-23dbf58dab2e req-a7ac7da8-8ebe-45f3-81a0-fc8db7b247b6 service nova] Releasing lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No BDM found with device name sda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No VIF found with MAC fa:16:3e:0c:c1:1f, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Using config drive
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updated VIF entry in instance network info cache for port 2fc84308-85e4-4b78-95f6-4a9df66f466a. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updating instance_info_cache with network_info: [{"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c6e8110-dc70-4523-8557-ede8dbd54761 req-89b660e8-d5c4-4cb7-acd8-70c1addce50f service nova] Releasing lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Creating config drive at /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.config
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcup9snu_ {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcup9snu_" returned: 0 in 0.113s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:34 user nova-compute[73079]: INFO nova.compute.claims [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Claim successful on node user
Aug 17 14:40:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.policy [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b99a131a54f479aaf9015cfc084583a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5c123a46c142c19c923adcb827766a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-9774b5a8-e6b1-47ce-80a7-360eb0490544 req-0e8a03f8-b308-4730-9670-269a18212f0b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9774b5a8-e6b1-47ce-80a7-360eb0490544 req-0e8a03f8-b308-4730-9670-269a18212f0b service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9774b5a8-e6b1-47ce-80a7-360eb0490544 req-0e8a03f8-b308-4730-9670-269a18212f0b service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9774b5a8-e6b1-47ce-80a7-360eb0490544 req-0e8a03f8-b308-4730-9670-269a18212f0b service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-9774b5a8-e6b1-47ce-80a7-360eb0490544 req-0e8a03f8-b308-4730-9670-269a18212f0b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:35 user nova-compute[73079]: WARNING nova.compute.manager [req-9774b5a8-e6b1-47ce-80a7-360eb0490544 req-0e8a03f8-b308-4730-9670-269a18212f0b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state None.
Aug 17 14:40:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Creating image(s)
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "/opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "/opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.454s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.273s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk 1073741824" returned: 0 in 0.113s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.396s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.262s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283237.4407063, a279bc96-247f-43e4-9d99-3dc690da4d0a => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] VM Resumed (Lifecycle Event)
Aug 17 14:40:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Cannot resize image /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lazy-loading 'migration_context' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Ensure instance console log exists: /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Instance spawned successfully.
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283237.4419491, a279bc96-247f-43e4-9d99-3dc690da4d0a => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] VM Started (Lifecycle Event)
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Successfully created port: 85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Took 10.26 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:37 user nova-compute[73079]: INFO nova.compute.manager [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Took 12.65 seconds to build instance.
Aug 17 14:40:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c8e2bf6-2e3a-432e-9acf-5f615ffb80a0 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.826s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:38 user nova-compute[73079]: WARNING nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state None.
Aug 17 14:40:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:38 user nova-compute[73079]: WARNING nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state active and task_state None.
Aug 17 14:40:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:38 user nova-compute[73079]: WARNING nova.compute.manager [req-49f0e096-afb1-4001-899a-6f4e0adb7df3 req-34b86125-8b23-47e9-9398-978a4156b162 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state active and task_state None.
Aug 17 14:40:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Successfully updated port: 85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquired lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-changed-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Refreshing instance network info cache due to event network-changed-85873d00-bda0-4344-a605-653ab82f45c1. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] Acquiring lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283239.999399, 04afdcd0-4876-4227-84f6-b2dcf8e041f4 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] VM Resumed (Lifecycle Event)
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Instance spawned successfully.
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283240.0047493, 04afdcd0-4876-4227-84f6-b2dcf8e041f4 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] VM Started (Lifecycle Event)
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Took 11.48 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updating instance_info_cache with network_info: [{"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:40 user nova-compute[73079]: INFO nova.compute.manager [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Took 13.34 seconds to build instance.
Aug 17 14:40:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Releasing lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Instance network_info: |[{"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] Acquired lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Refreshing network info cache for port 85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Start _get_guest_xml network_info=[{"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:40 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:40 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1bb07df2-1c3b-48e7-87a0-73170807a7c3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.669s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2071158390',display_name='tempest-VolumesAssistedSnapshotsTest-server-2071158390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2071158390',id=8,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvvDRQw/3qNlyb+J0WUTYidd//8MhFScFUZtZrfZB97MHznmQYGqmxzaMvRlreo0WJ4zcEiCgfyAuXlfjE09ig06yBZWn66SdZiDiRj3oyZtEMRp6U7jclywkkcLjOj8A==',key_name='tempest-keypair-653267722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f5c123a46c142c19c923adcb827766a',ramdisk_id='',reservation_id='r-ws4oi6bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-193124930',owner_user_name='tempest-VolumesAssistedSnapshotsTest-193124930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b99a131a54f479aaf9015cfc084583a',uuid=fc221fd3-a333-4a8e-8d14-d273c3f292e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Converting VIF {"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lazy-loading 'pci_devices' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:40 user nova-compute[73079]:   <uuid>fc221fd3-a333-4a8e-8d14-d273c3f292e5</uuid>
Aug 17 14:40:40 user nova-compute[73079]:   <name>instance-00000008</name>
Aug 17 14:40:40 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:40 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:40 user nova-compute[73079]:   <metadata>
Aug 17 14:40:40 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:40 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:40 user nova-compute[73079]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2071158390</nova:name>
Aug 17 14:40:40 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:40</nova:creationTime>
Aug 17 14:40:40 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:40 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:40 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:40 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:user uuid="9b99a131a54f479aaf9015cfc084583a">tempest-VolumesAssistedSnapshotsTest-193124930-project-member</nova:user>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:project uuid="4f5c123a46c142c19c923adcb827766a">tempest-VolumesAssistedSnapshotsTest-193124930</nova:project>
Aug 17 14:40:40 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:40 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:40 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:40 user nova-compute[73079]:         <nova:port uuid="85873d00-bda0-4344-a605-653ab82f45c1">
Aug 17 14:40:40 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 14:40:40 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:40 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:40 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:40 user nova-compute[73079]:   </metadata>
Aug 17 14:40:40 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:40 user nova-compute[73079]:     <system>
Aug 17 14:40:40 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:40 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:40 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:40 user nova-compute[73079]:       <entry name="serial">fc221fd3-a333-4a8e-8d14-d273c3f292e5</entry>
Aug 17 14:40:40 user nova-compute[73079]:       <entry name="uuid">fc221fd3-a333-4a8e-8d14-d273c3f292e5</entry>
Aug 17 14:40:40 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:40 user nova-compute[73079]:     </system>
Aug 17 14:40:40 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:40 user nova-compute[73079]:   <os>
Aug 17 14:40:40 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:40 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:40 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:40 user nova-compute[73079]:   </os>
Aug 17 14:40:40 user nova-compute[73079]:   <features>
Aug 17 14:40:40 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:40 user nova-compute[73079]:     <apic/>
Aug 17 14:40:40 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:40 user nova-compute[73079]:   </features>
Aug 17 14:40:40 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:40 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:40 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:40 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:40 user nova-compute[73079]:   </clock>
Aug 17 14:40:40 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:40 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:40 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:40 user nova-compute[73079]:   </cpu>
Aug 17 14:40:40 user nova-compute[73079]:   <devices>
Aug 17 14:40:40 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:40 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:40 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk"/>
Aug 17 14:40:40 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:40 user nova-compute[73079]:     </disk>
Aug 17 14:40:40 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:40 user nova-compute[73079]:       <mac address="fa:16:3e:b3:f8:77"/>
Aug 17 14:40:40 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:40 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:40 user nova-compute[73079]:       <target dev="tap85873d00-bd"/>
Aug 17 14:40:40 user nova-compute[73079]:     </interface>
Aug 17 14:40:40 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:40 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/console.log" append="off"/>
Aug 17 14:40:40 user nova-compute[73079]:     </serial>
Aug 17 14:40:40 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:40 user nova-compute[73079]:     <video>
Aug 17 14:40:40 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:40 user nova-compute[73079]:     </video>
Aug 17 14:40:40 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:40 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:40 user nova-compute[73079]:     </rng>
Aug 17 14:40:40 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:40 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:40 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:40 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:40 user nova-compute[73079]:   </devices>
Aug 17 14:40:40 user nova-compute[73079]: </domain>
Aug 17 14:40:40 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2071158390',display_name='tempest-VolumesAssistedSnapshotsTest-server-2071158390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2071158390',id=8,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvvDRQw/3qNlyb+J0WUTYidd//8MhFScFUZtZrfZB97MHznmQYGqmxzaMvRlreo0WJ4zcEiCgfyAuXlfjE09ig06yBZWn66SdZiDiRj3oyZtEMRp6U7jclywkkcLjOj8A==',key_name='tempest-keypair-653267722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f5c123a46c142c19c923adcb827766a',ramdisk_id='',reservation_id='r-ws4oi6bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-193124930',owner_user_name='tempest-VolumesAssistedSnapshotsTest-193124930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b99a131a54f479aaf9015cfc084583a',uuid=fc221fd3-a333-4a8e-8d14-d273c3f292e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Converting VIF {"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG os_vif [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85873d00-bd, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85873d00-bd, col_values=(('external_ids', {'iface-id': '85873d00-bda0-4344-a605-653ab82f45c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:f8:77', 'vm-uuid': 'fc221fd3-a333-4a8e-8d14-d273c3f292e5'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:40 user nova-compute[73079]: INFO os_vif [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd')
Aug 17 14:40:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] No VIF found with MAC fa:16:3e:b3:f8:77, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updated VIF entry in instance network info cache for port 85873d00-bda0-4344-a605-653ab82f45c1. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updating instance_info_cache with network_info: [{"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3644fba5-2918-442e-a7f3-433190b6e20b req-c9555873-9314-4acd-9017-8029452238e4 service nova] Releasing lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:40:43 user nova-compute[73079]: INFO nova.compute.claims [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Claim successful on node user
Aug 17 14:40:44 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:40:44 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:40:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.950s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:40:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:40:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:40:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:40:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:40:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Creating image(s)
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "/opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "/opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "/opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.policy [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e59b6ad093774f06a30ddf0285a63e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4175b65eebba485d8ca232694926e428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.270s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk 1073741824" returned: 0 in 0.072s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283245.7577229, fc221fd3-a333-4a8e-8d14-d273c3f292e5 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] VM Resumed (Lifecycle Event)
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Instance spawned successfully.
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283245.7648962, fc221fd3-a333-4a8e-8d14-d273c3f292e5 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] VM Started (Lifecycle Event)
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.321s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:46 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:46 user nova-compute[73079]: INFO nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Took 10.05 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Cannot resize image /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lazy-loading 'migration_context' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Ensure instance console log exists: /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:46 user nova-compute[73079]: INFO nova.compute.manager [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Took 11.74 seconds to build instance.
Aug 17 14:40:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ab57b12-d7c0-46df-8650-caa0dac0b31d tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.101s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Successfully created port: a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Successfully updated port: a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquired lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-changed-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Refreshing instance network info cache due to event network-changed-a569bdf5-76c8-4976-972c-0587421bac2f. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] Acquiring lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updating instance_info_cache with network_info: [{"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Releasing lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Instance network_info: |[{"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] Acquired lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Refreshing network info cache for port a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Start _get_guest_xml network_info=[{"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:40:48 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:48 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-119783382',display_name='tempest-TestVolumeSwap-server-119783382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-119783382',id=9,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9uZL2tGdr7NwlrEQn3zDWETNa/kT5ZLDbn8D+1AbFNWX+lvnY2aKYtxcuMkzDqlHT+VOt98jrC9MEQUHPfMSHtohkDXCsd3SQ3lIRXUbku+mZaDWTMG3MCN3eYaLttZA==',key_name='tempest-keypair-1872370290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4175b65eebba485d8ca232694926e428',ramdisk_id='',reservation_id='r-j5zla0sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-279138839',owner_user_name='tempest-TestVolumeSwap-279138839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e59b6ad093774f06a30ddf0285a63e95',uuid=42c5a511-402c-4712-a07e-1639512a7be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Converting VIF {"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lazy-loading 'pci_devices' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:40:48 user nova-compute[73079]:   <uuid>42c5a511-402c-4712-a07e-1639512a7be9</uuid>
Aug 17 14:40:48 user nova-compute[73079]:   <name>instance-00000009</name>
Aug 17 14:40:48 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:40:48 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:40:48 user nova-compute[73079]:   <metadata>
Aug 17 14:40:48 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:40:48 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:40:48 user nova-compute[73079]:       <nova:name>tempest-TestVolumeSwap-server-119783382</nova:name>
Aug 17 14:40:48 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:40:48</nova:creationTime>
Aug 17 14:40:48 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:40:48 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:40:48 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:40:48 user nova-compute[73079]:       <nova:owner>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:user uuid="e59b6ad093774f06a30ddf0285a63e95">tempest-TestVolumeSwap-279138839-project-member</nova:user>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:project uuid="4175b65eebba485d8ca232694926e428">tempest-TestVolumeSwap-279138839</nova:project>
Aug 17 14:40:48 user nova-compute[73079]:       </nova:owner>
Aug 17 14:40:48 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:40:48 user nova-compute[73079]:       <nova:ports>
Aug 17 14:40:48 user nova-compute[73079]:         <nova:port uuid="a569bdf5-76c8-4976-972c-0587421bac2f">
Aug 17 14:40:48 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:40:48 user nova-compute[73079]:         </nova:port>
Aug 17 14:40:48 user nova-compute[73079]:       </nova:ports>
Aug 17 14:40:48 user nova-compute[73079]:     </nova:instance>
Aug 17 14:40:48 user nova-compute[73079]:   </metadata>
Aug 17 14:40:48 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:40:48 user nova-compute[73079]:     <system>
Aug 17 14:40:48 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:40:48 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:40:48 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:40:48 user nova-compute[73079]:       <entry name="serial">42c5a511-402c-4712-a07e-1639512a7be9</entry>
Aug 17 14:40:48 user nova-compute[73079]:       <entry name="uuid">42c5a511-402c-4712-a07e-1639512a7be9</entry>
Aug 17 14:40:48 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:40:48 user nova-compute[73079]:     </system>
Aug 17 14:40:48 user nova-compute[73079]:   </sysinfo>
Aug 17 14:40:48 user nova-compute[73079]:   <os>
Aug 17 14:40:48 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:40:48 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:40:48 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:40:48 user nova-compute[73079]:   </os>
Aug 17 14:40:48 user nova-compute[73079]:   <features>
Aug 17 14:40:48 user nova-compute[73079]:     <acpi/>
Aug 17 14:40:48 user nova-compute[73079]:     <apic/>
Aug 17 14:40:48 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:40:48 user nova-compute[73079]:   </features>
Aug 17 14:40:48 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:40:48 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:40:48 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:40:48 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:40:48 user nova-compute[73079]:   </clock>
Aug 17 14:40:48 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:40:48 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:40:48 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:40:48 user nova-compute[73079]:   </cpu>
Aug 17 14:40:48 user nova-compute[73079]:   <devices>
Aug 17 14:40:48 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:40:48 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:40:48 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk"/>
Aug 17 14:40:48 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:40:48 user nova-compute[73079]:     </disk>
Aug 17 14:40:48 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:40:48 user nova-compute[73079]:       <mac address="fa:16:3e:ff:bc:39"/>
Aug 17 14:40:48 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:48 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:40:48 user nova-compute[73079]:       <target dev="tapa569bdf5-76"/>
Aug 17 14:40:48 user nova-compute[73079]:     </interface>
Aug 17 14:40:48 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:40:48 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/console.log" append="off"/>
Aug 17 14:40:48 user nova-compute[73079]:     </serial>
Aug 17 14:40:48 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:40:48 user nova-compute[73079]:     <video>
Aug 17 14:40:48 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:40:48 user nova-compute[73079]:     </video>
Aug 17 14:40:48 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:40:48 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:40:48 user nova-compute[73079]:     </rng>
Aug 17 14:40:48 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:40:48 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:40:48 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:40:48 user nova-compute[73079]:     </memballoon>
Aug 17 14:40:48 user nova-compute[73079]:   </devices>
Aug 17 14:40:48 user nova-compute[73079]: </domain>
Aug 17 14:40:48 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-119783382',display_name='tempest-TestVolumeSwap-server-119783382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-119783382',id=9,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9uZL2tGdr7NwlrEQn3zDWETNa/kT5ZLDbn8D+1AbFNWX+lvnY2aKYtxcuMkzDqlHT+VOt98jrC9MEQUHPfMSHtohkDXCsd3SQ3lIRXUbku+mZaDWTMG3MCN3eYaLttZA==',key_name='tempest-keypair-1872370290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4175b65eebba485d8ca232694926e428',ramdisk_id='',reservation_id='r-j5zla0sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-279138839',owner_user_name='tempest-TestVolumeSwap-279138839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e59b6ad093774f06a30ddf0285a63e95',uuid=42c5a511-402c-4712-a07e-1639512a7be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Converting VIF {"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG os_vif [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa569bdf5-76, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa569bdf5-76, col_values=(('external_ids', {'iface-id': 'a569bdf5-76c8-4976-972c-0587421bac2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:bc:39', 'vm-uuid': '42c5a511-402c-4712-a07e-1639512a7be9'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:48 user nova-compute[73079]: INFO os_vif [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76')
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:40:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] No VIF found with MAC fa:16:3e:ff:bc:39, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:40:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updated VIF entry in instance network info cache for port a569bdf5-76c8-4976-972c-0587421bac2f. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:40:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updating instance_info_cache with network_info: [{"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:40:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4f03a4e0-66c1-46b2-8309-88dd9734dcbc req-92b7e924-3f32-4451-9c3b-99ca466dce7d service nova] Releasing lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-1fd1aff7-a345-44bd-99d9-b18f1eb660bb req-2bbce693-6e44-4ca7-80cd-3f6f839403d9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1fd1aff7-a345-44bd-99d9-b18f1eb660bb req-2bbce693-6e44-4ca7-80cd-3f6f839403d9 service nova] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1fd1aff7-a345-44bd-99d9-b18f1eb660bb req-2bbce693-6e44-4ca7-80cd-3f6f839403d9 service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1fd1aff7-a345-44bd-99d9-b18f1eb660bb req-2bbce693-6e44-4ca7-80cd-3f6f839403d9 service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-1fd1aff7-a345-44bd-99d9-b18f1eb660bb req-2bbce693-6e44-4ca7-80cd-3f6f839403d9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] No waiting events found dispatching network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:50 user nova-compute[73079]: WARNING nova.compute.manager [req-1fd1aff7-a345-44bd-99d9-b18f1eb660bb req-2bbce693-6e44-4ca7-80cd-3f6f839403d9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received unexpected event network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f for instance with vm_state building and task_state spawning.
Aug 17 14:40:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-41655f49-692c-4d53-9b03-daa579c1724f req-17186b08-550c-40bf-83ef-5a765df16f8d service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-41655f49-692c-4d53-9b03-daa579c1724f req-17186b08-550c-40bf-83ef-5a765df16f8d service nova] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-41655f49-692c-4d53-9b03-daa579c1724f req-17186b08-550c-40bf-83ef-5a765df16f8d service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-41655f49-692c-4d53-9b03-daa579c1724f req-17186b08-550c-40bf-83ef-5a765df16f8d service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-41655f49-692c-4d53-9b03-daa579c1724f req-17186b08-550c-40bf-83ef-5a765df16f8d service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] No waiting events found dispatching network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:51 user nova-compute[73079]: WARNING nova.compute.manager [req-41655f49-692c-4d53-9b03-daa579c1724f req-17186b08-550c-40bf-83ef-5a765df16f8d service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received unexpected event network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 for instance with vm_state active and task_state None.
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-f074036f-9a24-4a40-aa5b-ddeee2f47716 req-a5c07a06-c9bd-48b3-868b-fefc9ae384be service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f074036f-9a24-4a40-aa5b-ddeee2f47716 req-a5c07a06-c9bd-48b3-868b-fefc9ae384be service nova] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f074036f-9a24-4a40-aa5b-ddeee2f47716 req-a5c07a06-c9bd-48b3-868b-fefc9ae384be service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f074036f-9a24-4a40-aa5b-ddeee2f47716 req-a5c07a06-c9bd-48b3-868b-fefc9ae384be service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-f074036f-9a24-4a40-aa5b-ddeee2f47716 req-a5c07a06-c9bd-48b3-868b-fefc9ae384be service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] No waiting events found dispatching network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:52 user nova-compute[73079]: WARNING nova.compute.manager [req-f074036f-9a24-4a40-aa5b-ddeee2f47716 req-a5c07a06-c9bd-48b3-868b-fefc9ae384be service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received unexpected event network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f for instance with vm_state building and task_state spawning.
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283252.5967937, 42c5a511-402c-4712-a07e-1639512a7be9 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] VM Resumed (Lifecycle Event)
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Instance spawned successfully.
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283252.5972726, 42c5a511-402c-4712-a07e-1639512a7be9 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] VM Started (Lifecycle Event)
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Took 7.69 seconds to spawn the instance on the hypervisor.
Aug 17 14:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:40:52 user nova-compute[73079]: INFO nova.compute.manager [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Took 9.16 seconds to build instance.
Aug 17 14:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0039bc21-d6ba-466e-aa78-62871cfb2b2e tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.346s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] No waiting events found dispatching network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received unexpected event network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] No waiting events found dispatching network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received unexpected event network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] No waiting events found dispatching network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received unexpected event network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] No waiting events found dispatching network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received unexpected event network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] No waiting events found dispatching network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received unexpected event network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] No waiting events found dispatching network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received unexpected event network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] No waiting events found dispatching network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:40:53 user nova-compute[73079]: WARNING nova.compute.manager [req-763d87cd-361e-4824-8d25-9e0eef077dad req-136d4443-2db6-4ae3-87cf-e5afbe85f4d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received unexpected event network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 for instance with vm_state active and task_state None.
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:40:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:40:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:41:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7333MB free_disk=25.796005249023438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 48d1d41e-1443-498d-a54e-f7ce734e3089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a279bc96-247f-43e4-9d99-3dc690da4d0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 42c5a511-402c-4712-a07e-1639512a7be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 14:41:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 14:41:03 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:41:03 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:41:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:41:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.927s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid a2c17473-d65d-4a2b-8382-ac868705c232 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updating instance_info_cache with network_info: [{"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:41:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:41:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:41:51 user nova-compute[73079]: INFO nova.compute.claims [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Claim successful on node user
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:41:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:41:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Creating image(s)
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "/opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "/opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG nova.policy [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e0b70013a36432dbf4d68815c643084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122c3c85977340e38328d6b9a690c768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk 1073741824" returned: 0 in 0.048s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.210s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Cannot resize image /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'migration_context' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Ensure instance console log exists: /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Successfully created port: 2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:41:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:41:54 user nova-compute[73079]: INFO nova.compute.claims [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Claim successful on node user
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Successfully updated port: 2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquired lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-changed-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Refreshing instance network info cache due to event network-changed-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] Acquiring lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:41:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updating instance_info_cache with network_info: [{"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.policy [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ae8ba1f04474c00be03b2d8ea745f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c83cb8ee234c77bf65a94c176b47b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Releasing lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Instance network_info: |[{"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] Acquired lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Refreshing network info cache for port 2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Start _get_guest_xml network_info=[{"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:41:54 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:41:54 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-449073019',display_name='tempest-TestServerVolumeAttachmentScenario-server-449073019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-449073019',id=10,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcNzZ1rL+YlDhR+dp59DyHk6W1wXGtQmREYjfdO/vKADHdNr18VvhXiep3vohm/NnqrA28cp25mSfyIw9+CnaXgFe6fd/XA+S6sfoxi9Lkiw1siQRLyI0CQjjEkP+uJeA==',key_name='tempest-keypair-175156898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='122c3c85977340e38328d6b9a690c768',ramdisk_id='',reservation_id='r-yjg8gz8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1636072611',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1636072611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e0b70013a36432dbf4d68815c643084',uuid=cb8ad507-b5da-467c-8008-f43573b7e7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Converting VIF {"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'pci_devices' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:41:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Creating image(s)
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "/opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "/opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:41:54 user nova-compute[73079]:   <uuid>cb8ad507-b5da-467c-8008-f43573b7e7c3</uuid>
Aug 17 14:41:54 user nova-compute[73079]:   <name>instance-0000000a</name>
Aug 17 14:41:54 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:41:54 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:41:54 user nova-compute[73079]:   <metadata>
Aug 17 14:41:54 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:41:54 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:41:54 user nova-compute[73079]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-449073019</nova:name>
Aug 17 14:41:54 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:41:54</nova:creationTime>
Aug 17 14:41:54 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:41:54 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:41:54 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:41:54 user nova-compute[73079]:       <nova:owner>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:user uuid="2e0b70013a36432dbf4d68815c643084">tempest-TestServerVolumeAttachmentScenario-1636072611-project-member</nova:user>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:project uuid="122c3c85977340e38328d6b9a690c768">tempest-TestServerVolumeAttachmentScenario-1636072611</nova:project>
Aug 17 14:41:54 user nova-compute[73079]:       </nova:owner>
Aug 17 14:41:54 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:41:54 user nova-compute[73079]:       <nova:ports>
Aug 17 14:41:54 user nova-compute[73079]:         <nova:port uuid="2f2b56eb-a29f-4159-a45d-7cc7cd2eea80">
Aug 17 14:41:54 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 14:41:54 user nova-compute[73079]:         </nova:port>
Aug 17 14:41:54 user nova-compute[73079]:       </nova:ports>
Aug 17 14:41:54 user nova-compute[73079]:     </nova:instance>
Aug 17 14:41:54 user nova-compute[73079]:   </metadata>
Aug 17 14:41:54 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:41:54 user nova-compute[73079]:     <system>
Aug 17 14:41:54 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:41:54 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:41:54 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:41:54 user nova-compute[73079]:       <entry name="serial">cb8ad507-b5da-467c-8008-f43573b7e7c3</entry>
Aug 17 14:41:54 user nova-compute[73079]:       <entry name="uuid">cb8ad507-b5da-467c-8008-f43573b7e7c3</entry>
Aug 17 14:41:54 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:41:54 user nova-compute[73079]:     </system>
Aug 17 14:41:54 user nova-compute[73079]:   </sysinfo>
Aug 17 14:41:54 user nova-compute[73079]:   <os>
Aug 17 14:41:54 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:41:54 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:41:54 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:41:54 user nova-compute[73079]:   </os>
Aug 17 14:41:54 user nova-compute[73079]:   <features>
Aug 17 14:41:54 user nova-compute[73079]:     <acpi/>
Aug 17 14:41:54 user nova-compute[73079]:     <apic/>
Aug 17 14:41:54 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:41:54 user nova-compute[73079]:   </features>
Aug 17 14:41:54 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:41:54 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:41:54 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:41:54 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:41:54 user nova-compute[73079]:   </clock>
Aug 17 14:41:54 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:41:54 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:41:54 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:41:54 user nova-compute[73079]:   </cpu>
Aug 17 14:41:54 user nova-compute[73079]:   <devices>
Aug 17 14:41:54 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:41:54 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:41:54 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk"/>
Aug 17 14:41:54 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:41:54 user nova-compute[73079]:     </disk>
Aug 17 14:41:54 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:41:54 user nova-compute[73079]:       <mac address="fa:16:3e:19:b6:62"/>
Aug 17 14:41:54 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:41:54 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:41:54 user nova-compute[73079]:       <target dev="tap2f2b56eb-a2"/>
Aug 17 14:41:54 user nova-compute[73079]:     </interface>
Aug 17 14:41:54 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:41:54 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/console.log" append="off"/>
Aug 17 14:41:54 user nova-compute[73079]:     </serial>
Aug 17 14:41:54 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:41:54 user nova-compute[73079]:     <video>
Aug 17 14:41:54 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:41:54 user nova-compute[73079]:     </video>
Aug 17 14:41:54 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:41:54 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:41:54 user nova-compute[73079]:     </rng>
Aug 17 14:41:54 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:41:54 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:41:54 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:41:54 user nova-compute[73079]:     </memballoon>
Aug 17 14:41:54 user nova-compute[73079]:   </devices>
Aug 17 14:41:54 user nova-compute[73079]: </domain>
Aug 17 14:41:54 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-449073019',display_name='tempest-TestServerVolumeAttachmentScenario-server-449073019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-449073019',id=10,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcNzZ1rL+YlDhR+dp59DyHk6W1wXGtQmREYjfdO/vKADHdNr18VvhXiep3vohm/NnqrA28cp25mSfyIw9+CnaXgFe6fd/XA+S6sfoxi9Lkiw1siQRLyI0CQjjEkP+uJeA==',key_name='tempest-keypair-175156898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='122c3c85977340e38328d6b9a690c768',ramdisk_id='',reservation_id='r-yjg8gz8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1636072611',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1636072611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e0b70013a36432dbf4d68815c643084',uuid=cb8ad507-b5da-467c-8008-f43573b7e7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Converting VIF {"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG os_vif [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:41:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f2b56eb-a2, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f2b56eb-a2, col_values=(('external_ids', {'iface-id': '2f2b56eb-a29f-4159-a45d-7cc7cd2eea80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:b6:62', 'vm-uuid': 'cb8ad507-b5da-467c-8008-f43573b7e7c3'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:55 user nova-compute[73079]: INFO os_vif [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2')
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No VIF found with MAC fa:16:3e:19:b6:62, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.network.neutron [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updated VIF entry in instance network info cache for port 2f2b56eb-a29f-4159-a45d-7cc7cd2eea80. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.network.neutron [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updating instance_info_cache with network_info: [{"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk 1073741824" returned: 0 in 0.057s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9b91c0e5-d241-4ede-bcac-3c6e36ac5b28 req-b512b66e-85d8-4072-8bd8-63dd9c5efe0b service nova] Releasing lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Successfully created port: f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Cannot resize image /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lazy-loading 'migration_context' on Instance uuid 5e196ca7-2142-4c24-b3fe-800e360cbe49 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Ensure instance console log exists: /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Successfully updated port: f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "refresh_cache-5e196ca7-2142-4c24-b3fe-800e360cbe49" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquired lock "refresh_cache-5e196ca7-2142-4c24-b3fe-800e360cbe49" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-changed-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Refreshing instance network info cache due to event network-changed-f043655d-a46b-409f-9e59-ddaae9b4297c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] Acquiring lock "refresh_cache-5e196ca7-2142-4c24-b3fe-800e360cbe49" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Updating instance_info_cache with network_info: [{"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Releasing lock "refresh_cache-5e196ca7-2142-4c24-b3fe-800e360cbe49" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Instance network_info: |[{"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] Acquired lock "refresh_cache-5e196ca7-2142-4c24-b3fe-800e360cbe49" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.neutron [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Refreshing network info cache for port f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Start _get_guest_xml network_info=[{"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-2d5e4999-a912-4f7e-8dcc-c6c840fec1a1 req-c0fa6570-2cad-47d0-a5a8-97cc8fb11fa4 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2d5e4999-a912-4f7e-8dcc-c6c840fec1a1 req-c0fa6570-2cad-47d0-a5a8-97cc8fb11fa4 service nova] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2d5e4999-a912-4f7e-8dcc-c6c840fec1a1 req-c0fa6570-2cad-47d0-a5a8-97cc8fb11fa4 service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2d5e4999-a912-4f7e-8dcc-c6c840fec1a1 req-c0fa6570-2cad-47d0-a5a8-97cc8fb11fa4 service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-2d5e4999-a912-4f7e-8dcc-c6c840fec1a1 req-c0fa6570-2cad-47d0-a5a8-97cc8fb11fa4 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] No waiting events found dispatching network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:41:56 user nova-compute[73079]: WARNING nova.compute.manager [req-2d5e4999-a912-4f7e-8dcc-c6c840fec1a1 req-c0fa6570-2cad-47d0-a5a8-97cc8fb11fa4 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received unexpected event network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 for instance with vm_state building and task_state spawning.
Aug 17 14:41:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:41:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1978746464',display_name='tempest-ServersNegativeTestJSON-server-1978746464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1978746464',id=11,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40c83cb8ee234c77bf65a94c176b47b5',ramdisk_id='',reservation_id='r-lubumqbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146357167',owner_user_name='tempest-ServersNegativeTestJSON-146357167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:41:55Z,user_data=None,user_id='8ae8ba1f04474c00be03b2d8ea745f97',uuid=5e196ca7-2142-4c24-b3fe-800e360cbe49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converting VIF {"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.objects.instance [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e196ca7-2142-4c24-b3fe-800e360cbe49 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:41:56 user nova-compute[73079]:   <uuid>5e196ca7-2142-4c24-b3fe-800e360cbe49</uuid>
Aug 17 14:41:56 user nova-compute[73079]:   <name>instance-0000000b</name>
Aug 17 14:41:56 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:41:56 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:41:56 user nova-compute[73079]:   <metadata>
Aug 17 14:41:56 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:41:56 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:41:56 user nova-compute[73079]:       <nova:name>tempest-ServersNegativeTestJSON-server-1978746464</nova:name>
Aug 17 14:41:56 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:41:56</nova:creationTime>
Aug 17 14:41:56 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:41:56 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:41:56 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:41:56 user nova-compute[73079]:       <nova:owner>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:user uuid="8ae8ba1f04474c00be03b2d8ea745f97">tempest-ServersNegativeTestJSON-146357167-project-member</nova:user>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:project uuid="40c83cb8ee234c77bf65a94c176b47b5">tempest-ServersNegativeTestJSON-146357167</nova:project>
Aug 17 14:41:56 user nova-compute[73079]:       </nova:owner>
Aug 17 14:41:56 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:41:56 user nova-compute[73079]:       <nova:ports>
Aug 17 14:41:56 user nova-compute[73079]:         <nova:port uuid="f043655d-a46b-409f-9e59-ddaae9b4297c">
Aug 17 14:41:56 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 14:41:56 user nova-compute[73079]:         </nova:port>
Aug 17 14:41:56 user nova-compute[73079]:       </nova:ports>
Aug 17 14:41:56 user nova-compute[73079]:     </nova:instance>
Aug 17 14:41:56 user nova-compute[73079]:   </metadata>
Aug 17 14:41:56 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:41:56 user nova-compute[73079]:     <system>
Aug 17 14:41:56 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:41:56 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:41:56 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:41:56 user nova-compute[73079]:       <entry name="serial">5e196ca7-2142-4c24-b3fe-800e360cbe49</entry>
Aug 17 14:41:56 user nova-compute[73079]:       <entry name="uuid">5e196ca7-2142-4c24-b3fe-800e360cbe49</entry>
Aug 17 14:41:56 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:41:56 user nova-compute[73079]:     </system>
Aug 17 14:41:56 user nova-compute[73079]:   </sysinfo>
Aug 17 14:41:56 user nova-compute[73079]:   <os>
Aug 17 14:41:56 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:41:56 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:41:56 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:41:56 user nova-compute[73079]:   </os>
Aug 17 14:41:56 user nova-compute[73079]:   <features>
Aug 17 14:41:56 user nova-compute[73079]:     <acpi/>
Aug 17 14:41:56 user nova-compute[73079]:     <apic/>
Aug 17 14:41:56 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:41:56 user nova-compute[73079]:   </features>
Aug 17 14:41:56 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:41:56 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:41:56 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:41:56 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:41:56 user nova-compute[73079]:   </clock>
Aug 17 14:41:56 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:41:56 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:41:56 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:41:56 user nova-compute[73079]:   </cpu>
Aug 17 14:41:56 user nova-compute[73079]:   <devices>
Aug 17 14:41:56 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:41:56 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:41:56 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk"/>
Aug 17 14:41:56 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:41:56 user nova-compute[73079]:     </disk>
Aug 17 14:41:56 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:41:56 user nova-compute[73079]:       <mac address="fa:16:3e:85:26:d2"/>
Aug 17 14:41:56 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:41:56 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:41:56 user nova-compute[73079]:       <target dev="tapf043655d-a4"/>
Aug 17 14:41:56 user nova-compute[73079]:     </interface>
Aug 17 14:41:56 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:41:56 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/console.log" append="off"/>
Aug 17 14:41:56 user nova-compute[73079]:     </serial>
Aug 17 14:41:56 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:41:56 user nova-compute[73079]:     <video>
Aug 17 14:41:56 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:41:56 user nova-compute[73079]:     </video>
Aug 17 14:41:56 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:41:56 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:41:56 user nova-compute[73079]:     </rng>
Aug 17 14:41:56 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:41:56 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:41:56 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:41:56 user nova-compute[73079]:     </memballoon>
Aug 17 14:41:56 user nova-compute[73079]:   </devices>
Aug 17 14:41:56 user nova-compute[73079]: </domain>
Aug 17 14:41:56 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1978746464',display_name='tempest-ServersNegativeTestJSON-server-1978746464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1978746464',id=11,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40c83cb8ee234c77bf65a94c176b47b5',ramdisk_id='',reservation_id='r-lubumqbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-146357167',owner_user_name='tempest-ServersNegativeTestJSON-146357167-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:41:55Z,user_data=None,user_id='8ae8ba1f04474c00be03b2d8ea745f97',uuid=5e196ca7-2142-4c24-b3fe-800e360cbe49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converting VIF {"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG os_vif [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf043655d-a4, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf043655d-a4, col_values=(('external_ids', {'iface-id': 'f043655d-a46b-409f-9e59-ddaae9b4297c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:26:d2', 'vm-uuid': '5e196ca7-2142-4c24-b3fe-800e360cbe49'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:56 user nova-compute[73079]: INFO os_vif [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4')
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:41:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] No VIF found with MAC fa:16:3e:85:26:d2, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG nova.network.neutron [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Updated VIF entry in instance network info cache for port f043655d-a46b-409f-9e59-ddaae9b4297c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG nova.network.neutron [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Updating instance_info_cache with network_info: [{"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-efea81dc-5505-4835-b2e3-2ae06fcee19f req-5d7fdec5-796c-459b-963a-2b39f340105f service nova] Releasing lock "refresh_cache-5e196ca7-2142-4c24-b3fe-800e360cbe49" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f0a10070-93d9-4602-b013-21c0395d2e2c req-c0a0f71d-a66e-4642-a6f9-31f8c74df87b service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f0a10070-93d9-4602-b013-21c0395d2e2c req-c0a0f71d-a66e-4642-a6f9-31f8c74df87b service nova] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f0a10070-93d9-4602-b013-21c0395d2e2c req-c0a0f71d-a66e-4642-a6f9-31f8c74df87b service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f0a10070-93d9-4602-b013-21c0395d2e2c req-c0a0f71d-a66e-4642-a6f9-31f8c74df87b service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f0a10070-93d9-4602-b013-21c0395d2e2c req-c0a0f71d-a66e-4642-a6f9-31f8c74df87b service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] No waiting events found dispatching network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:41:58 user nova-compute[73079]: WARNING nova.compute.manager [req-f0a10070-93d9-4602-b013-21c0395d2e2c req-c0a0f71d-a66e-4642-a6f9-31f8c74df87b service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received unexpected event network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c for instance with vm_state building and task_state spawning.
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] No waiting events found dispatching network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:41:58 user nova-compute[73079]: WARNING nova.compute.manager [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received unexpected event network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 for instance with vm_state building and task_state spawning.
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing instance network info cache due to event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:58 user nova-compute[73079]: DEBUG nova.network.neutron [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283319.007632, cb8ad507-b5da-467c-8008-f43573b7e7c3 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] VM Resumed (Lifecycle Event)
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-changed-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Refreshing instance network info cache due to event network-changed-5955a467-f321-452d-812d-4796e5b7d6df. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Refreshing network info cache for port 5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Instance spawned successfully.
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lazy-loading 'flavor' on Instance uuid 48d1d41e-1443-498d-a54e-f7ce734e3089 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283319.0138366, cb8ad507-b5da-467c-8008-f43573b7e7c3 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] VM Started (Lifecycle Event)
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Took 7.68 seconds to build instance.
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a4ccc3d4-da37-473f-94f2-90ca2a2fc41b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.785s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updating instance_info_cache with network_info: [{"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-48d1d41e-1443-498d-a54e-f7ce734e3089" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Attaching volume 899e017f-fbb8-4b66-870e-4abc9b27e345 to /dev/vdb
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG os_brick.utils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:41:59 user nova-compute[73079]: INFO oslo.privsep.daemon [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpnwqbyx98/privsep.sock']
Aug 17 14:41:59 user sudo[84573]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpnwqbyx98/privsep.sock
Aug 17 14:41:59 user sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updated VIF entry in instance network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f606b05c-abc4-4b11-bdc2-d6c69fa78e88 req-85878be0-719d-4e37-a5ff-5c98ed52eb06 service nova] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updated VIF entry in instance network info cache for port 5955a467-f321-452d-812d-4796e5b7d6df. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f7f55641-2b24-4f12-a5f1-d6c622fa7f12 req-a69380a1-e53d-46b4-a9ab-33906b4ee7a4 service nova] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.compute.manager [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] instance snapshotting
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Beginning live snapshot process
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283320.755789, 5e196ca7-2142-4c24-b3fe-800e360cbe49 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] VM Resumed (Lifecycle Event)
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Instance spawned successfully.
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-a15572bc-d295-4688-827a-fb19527d41f1 req-47d548c2-0255-497c-852a-a4b7e2189682 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a15572bc-d295-4688-827a-fb19527d41f1 req-47d548c2-0255-497c-852a-a4b7e2189682 service nova] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a15572bc-d295-4688-827a-fb19527d41f1 req-47d548c2-0255-497c-852a-a4b7e2189682 service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a15572bc-d295-4688-827a-fb19527d41f1 req-47d548c2-0255-497c-852a-a4b7e2189682 service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-a15572bc-d295-4688-827a-fb19527d41f1 req-47d548c2-0255-497c-852a-a4b7e2189682 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] No waiting events found dispatching network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:00 user nova-compute[73079]: WARNING nova.compute.manager [req-a15572bc-d295-4688-827a-fb19527d41f1 req-47d548c2-0255-497c-852a-a4b7e2189682 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received unexpected event network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c for instance with vm_state building and task_state spawning.
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283320.7600276, 5e196ca7-2142-4c24-b3fe-800e360cbe49 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] VM Started (Lifecycle Event)
Aug 17 14:42:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:00 user nova-compute[73079]: INFO nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:42:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: INFO nova.compute.manager [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Took 6.98 seconds to build instance.
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-60ea2cd6-edec-4fcd-9bdc-e3601179e8dd tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.126s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.214s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwrt525bm/f339676b74df4b15a75d022480c33934.delta 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwrt525bm/f339676b74df4b15a75d022480c33934.delta 1073741824" returned: 0 in 0.068s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 14:42:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73079) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 14:42:01 user nova-compute[73079]: INFO nova.virt.libvirt.host [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] UEFI support detected
Aug 17 14:42:01 user sudo[84573]: pam_unix(sudo:session): session closed for user root
Aug 17 14:42:01 user nova-compute[73079]: INFO oslo.privsep.daemon [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Spawned new privsep daemon via rootwrap
Aug 17 14:42:01 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 14:42:01 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 14:42:01 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 14:42:01 user nova-compute[73079]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84615
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b116800-4c6d-40fc-8127-eade257a4874]: (2,) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ab6f9-faad-4946-8fee-1342bb40a9b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:01 user nova-compute[73079]: WARNING os_brick.initiator.connectors.nvmeof [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f129f-fe9b-44cf-95c3-43b72bff9a34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[75070378-2717-4729-a834-7263dd5c2acd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e1d7e9-7fac-4803-8f74-5c6724bb07e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:02 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7060b6d8-8010-4544-a203-a9dae642d223]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG os_brick.utils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] <== get_connector_properties: return (2310ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updating existing volume attachment record: cbeacb75-d09a-41e6-a9cc-9861a2344358 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:42:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwrt525bm/f339676b74df4b15a75d022480c33934.delta /opt/stack/data/nova/instances/snapshots/tmpwrt525bm/f339676b74df4b15a75d022480c33934 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwrt525bm/f339676b74df4b15a75d022480c33934.delta /opt/stack/data/nova/instances/snapshots/tmpwrt525bm/f339676b74df4b15a75d022480c33934" returned: 0 in 0.662s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Snapshot extracted, beginning image upload
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-changed-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Refreshing instance network info cache due to event network-changed-88abdc44-4987-4e42-aac5-80b85b07fa9e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Refreshing network info cache for port 88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:05 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:42:05 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=6985MB free_disk=25.69965362548828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 48d1d41e-1443-498d-a54e-f7ce734e3089 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a279bc96-247f-43e4-9d99-3dc690da4d0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 42c5a511-402c-4712-a07e-1639512a7be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cb8ad507-b5da-467c-8008-f43573b7e7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 5e196ca7-2142-4c24-b3fe-800e360cbe49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:42:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG nova.network.neutron [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updated VIF entry in instance network info cache for port 88abdc44-4987-4e42-aac5-80b85b07fa9e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG nova.network.neutron [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1ab1d05b-894d-449f-908c-b44bc42d3379 req-17a314bd-df2e-4fb5-8d6a-5d5cae489f2f service nova] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:42:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:42:07 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Snapshot image upload complete
Aug 17 14:42:07 user nova-compute[73079]: INFO nova.compute.manager [None req-af0a2f88-23f2-4312-949d-fa51a4aece1a tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Took 7.17 seconds to snapshot the instance on the hypervisor.
Aug 17 14:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:10 user nova-compute[73079]: INFO nova.compute.manager [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Attaching volume 4a126b6f-9390-435a-89a1-fa19e9b3e107 to /dev/vdb
Aug 17 14:42:10 user nova-compute[73079]: DEBUG os_brick.utils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a07d6-07f6-4878-a66d-d5259c28ddd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac1958-1548-4d1c-8f1f-d28b0d982493]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f42d51-4cad-4968-98a5-360d40b1244a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e0d946-6e82-4bb3-ae71-ab23c4b78f14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:10 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c16d7-7077-4107-859b-1c072e10820a]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG os_brick.utils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating existing volume attachment record: ca78de04-3140-4b8d-ba96-5c75d82fd70a {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:42:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connector [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Factory for ISCSI on None {{(pid=73079) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seYxLfNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:14 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:14 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:14 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f8381-621b-427a-a981-a10fef475260]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:42:14 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbcbd51-bdc4-4d69-8d3e-d149774b9eaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345] added
Aug 17 14:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8f94a-8b1c-4815-85cb-976154016e8f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f31645-c832-4149-9d38-f180edd7eb70]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v seYxLfNV {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v seYxLfNV" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b89f16a-a843-4be0-bf7a-7b3ffb1e040c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'seYxLfNV'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba4d9b9-387f-49a4-b0f6-d56a9ce4a474]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8424b95-e88a-44b3-b4bf-baf2bbae90c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 14:42:14 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 14:42:14 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:14 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 14:42:14 user nova-compute[73079]: 
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6d37c-ec27-4a1c-8736-2837f546a711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260]
Aug 17 14:42:14 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baa86af-2716-4e08-8173-94c6ff8b4a2d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f340f2-d0a5-4c6a-b26c-efd7ef8f2484]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 (non-flash)
Aug 17 14:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 (non-flash)
Aug 17 14:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21322a7c-78ea-4974-9917-5e34a87ecd4f]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seYxLfNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:42:15 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:15 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23236666337363262', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236666337363262', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:42:15 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lazy-loading 'flavor' on Instance uuid 48d1d41e-1443-498d-a54e-f7ce734e3089 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:42:15 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:15 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:42:15 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:15 user nova-compute[73079]:   <serial>899e017f-fbb8-4b66-870e-4abc9b27e345</serial>
Aug 17 14:42:15 user nova-compute[73079]: </disk>
Aug 17 14:42:15 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:42:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] No VIF found with MAC fa:16:3e:39:0e:06, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ce9d90bd-8d49-49e6-8f32-2b99bbf5eaf7 tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.591s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:16 user nova-compute[73079]: INFO nova.compute.manager [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Terminating instance
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-changed-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Refreshing instance network info cache due to event network-changed-88d49d09-b3cc-4344-afc5-e4055c2c9a8e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] Acquiring lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] Acquired lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Refreshing network info cache for port 88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-9d2f5bae-466f-4ad1-b785-9f827afa2c6c req-801b08bd-d315-44df-8537-9ef080d8c67b service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-vif-unplugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9d2f5bae-466f-4ad1-b785-9f827afa2c6c req-801b08bd-d315-44df-8537-9ef080d8c67b service nova] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9d2f5bae-466f-4ad1-b785-9f827afa2c6c req-801b08bd-d315-44df-8537-9ef080d8c67b service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9d2f5bae-466f-4ad1-b785-9f827afa2c6c req-801b08bd-d315-44df-8537-9ef080d8c67b service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-9d2f5bae-466f-4ad1-b785-9f827afa2c6c req-801b08bd-d315-44df-8537-9ef080d8c67b service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] No waiting events found dispatching network-vif-unplugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-9d2f5bae-466f-4ad1-b785-9f827afa2c6c req-801b08bd-d315-44df-8537-9ef080d8c67b service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-vif-unplugged-9105402c-3986-4eea-b944-0ac652219a43 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:42:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Instance destroyed successfully.
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lazy-loading 'resources' on Instance uuid 48d1d41e-1443-498d-a54e-f7ce734e3089 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2023844696',display_name='tempest-DeleteServersTestJSON-server-2023844696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2023844696',id=2,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eec98cb1ae342f08da74df4b2d76076',ramdisk_id='',reservation_id='r-gq56xt4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-723569045',owner_user_name='tempest-DeleteServersTestJSON-723569045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:40:26Z,user_data=None,user_id='3ca8af258ca94a9dbfab07fb110fb813',uuid=48d1d41e-1443-498d-a54e-f7ce734e3089,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Converting VIF {"id": "9105402c-3986-4eea-b944-0ac652219a43", "address": "fa:16:3e:39:0e:06", "network": {"id": "16f15852-15f4-4de7-a39b-2282b2769870", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-917332679-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0eec98cb1ae342f08da74df4b2d76076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9105402c-39", "ovs_interfaceid": "9105402c-3986-4eea-b944-0ac652219a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_vif [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9105402c-39, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:17 user nova-compute[73079]: INFO os_vif [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:0e:06,bridge_name='br-int',has_traffic_filtering=True,id=9105402c-3986-4eea-b944-0ac652219a43,network=Network(16f15852-15f4-4de7-a39b-2282b2769870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9105402c-39')
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'seYxLfNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:17 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f2e8c-fc20-42f1-bf36-7821df55db15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[929fd561-e5a2-4191-9e36-b73c9c586fd0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 (non-flash)
Aug 17 14:42:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 (non-flash)
Aug 17 14:42:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e84e69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62683e-3412-4836-9ecf-70996d0a4805]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d070fc1-7ff6-4e62-8ce4-f09f8203f24e]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa7cbbd-03c3-4d9c-b8df-a9919ea60945]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148cbd6-44d5-4dc6-b6fa-5a1eb1c3d994]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8633bf9-4940-489d-9ffe-7d5128fe3bf5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ea4627-6cb1-4c12-803a-6e404513d185]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260]
Aug 17 14:42:17 user nova-compute[73079]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899e017f-fbb8-4b66-870e-4abc9b27e345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c60d67-3bc7-41f3-8e1b-4803df5533f1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] <== disconnect_volume: return (282ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:42:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Deleting instance files /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089_del
Aug 17 14:42:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Deletion of /opt/stack/data/nova/instances/48d1d41e-1443-498d-a54e-f7ce734e3089_del complete
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updated VIF entry in instance network info cache for port 88d49d09-b3cc-4344-afc5-e4055c2c9a8e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updating instance_info_cache with network_info: [{"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f04aa6bf-0825-4a6c-89c1-68986e24351b req-a9396aa7-4938-4254-972a-a43acf536723 service nova] Releasing lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:17 user nova-compute[73079]: INFO nova.compute.manager [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 17 14:42:17 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:42:17 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:19 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Took 1.33 seconds to deallocate network for instance.
Aug 17 14:42:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] Acquiring lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] No waiting events found dispatching network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:19 user nova-compute[73079]: WARNING nova.compute.manager [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received unexpected event network-vif-plugged-9105402c-3986-4eea-b944-0ac652219a43 for instance with vm_state active and task_state deleting.
Aug 17 14:42:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-changed-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Refreshing instance network info cache due to event network-changed-2fc84308-85e4-4b78-95f6-4a9df66f466a. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] Acquiring lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] Acquired lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:42:19 user nova-compute[73079]: DEBUG nova.network.neutron [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Refreshing network info cache for port 2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:42:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updated VIF entry in instance network info cache for port 2fc84308-85e4-4b78-95f6-4a9df66f466a. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:42:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updating instance_info_cache with network_info: [{"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] Releasing lock "refresh_cache-04afdcd0-4876-4227-84f6-b2dcf8e041f4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e3d14d-7c8a-4b3f-be10-2283fb38a78d req-14adb9a7-fafe-498e-aa21-0c5f1236b991 service nova] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Received event network-vif-deleted-9105402c-3986-4eea-b944-0ac652219a43 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'flavor' on Instance uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:21 user nova-compute[73079]: INFO nova.compute.manager [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Attaching volume 1843e105-5de2-4c05-a712-8c7b6197b06c to /dev/vdb
Aug 17 14:42:21 user nova-compute[73079]: DEBUG os_brick.utils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1957c8-bb81-4ace-8dcb-3ce4a25c6939]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4071c9e-a907-4896-87b9-81114f346f66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c323c336-db1c-47e9-ac28-9e2ffdc6158e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e326277-cf99-4fc4-b21c-badbc9c39d79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:21 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31c364-35b4-485b-a9f9-8402a1511085]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG os_brick.utils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:21 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updating existing volume attachment record: 004cfa11-39f3-4977-a0fe-92c5a5f27ba5 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:42:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:22 user nova-compute[73079]: INFO nova.compute.manager [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Took 3.45 seconds to detach 1 volumes for instance.
Aug 17 14:42:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:23 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:42:23 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:42:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:23 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Deleted allocations for instance 48d1d41e-1443-498d-a54e-f7ce734e3089
Aug 17 14:42:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07d00fa0-eda5-4fe1-92c2-aca1c01ef7ac tempest-DeleteServersTestJSON-723569045 tempest-DeleteServersTestJSON-723569045-project-member] Lock "48d1d41e-1443-498d-a54e-f7ce734e3089" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.761s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lazy-loading 'flavor' on Instance uuid 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:24 user nova-compute[73079]: INFO nova.compute.manager [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Attaching volume 385fc141-105e-4955-8f99-69dc3e0efe78 to /dev/sdc
Aug 17 14:42:24 user nova-compute[73079]: DEBUG os_brick.utils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afa0ca-a367-4448-8eef-6db58cac2d75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f05ca-59a3-4437-8d41-0f6213853e33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7164235b-4f4a-481c-ab98-9f174e1bfbce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106d908-a163-4637-9abd-53ef240235b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:24 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f8b0d6-e071-4b93-ab29-fbdf88a82808]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG os_brick.utils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:24 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updating existing volume attachment record: e8891914-15aa-49dc-b87a-dda5dd62e320 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-changed-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Refreshing instance network info cache due to event network-changed-85873d00-bda0-4344-a605-653ab82f45c1. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] Acquiring lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] Acquired lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG nova.network.neutron [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Refreshing network info cache for port 85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG nova.network.neutron [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updated VIF entry in instance network info cache for port 85873d00-bda0-4344-a605-653ab82f45c1. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG nova.network.neutron [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updating instance_info_cache with network_info: [{"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5e20b438-f3b8-4a7b-8f87-e3ec3e27726a req-a3a33030-5b92-480a-89a9-84999b4d20ca service nova] Releasing lock "refresh_cache-fc221fd3-a333-4a8e-8d14-d273c3f292e5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:28 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:28 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:28 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27a9ae7-3b21-4205-96bd-84ba106428e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:42:28 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba9fe0-9396-4af9-94c3-82a185cdb1a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107] added
Aug 17 14:42:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.074s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00995da-3fc0-49b0-8c25-ac20585319a9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49eb3f0-bd76-4fdc-9ff8-5b85a2148a42]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNrnIuoe {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNrnIuoe" returned: 0 in 0.065s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9469f422-9ddb-4c48-abf1-0409957a8e88]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNrnIuoe'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.081s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0149865-6eef-43df-b232-035be38ab210]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac29aab-9adb-48b7-add5-d8701695115d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 14:42:28 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 14:42:28 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:28 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 14:42:28 user nova-compute[73079]: 
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18e2360-37cc-44a1-93f2-b277b164db7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]
Aug 17 14:42:29 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lazy-loading 'flavor' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8d3be-0439-46ff-90c4-a53728a8817f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ed530-613f-4d19-9549-e433d6a9c26d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae5185-2d65-42fd-85c4-59e67ed12272]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:29 user nova-compute[73079]: INFO nova.compute.manager [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Attaching volume 9f41cd27-4d84-4ed2-9682-854811fa07bf to /dev/vdb
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.utils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6fd74-a6ca-4d5f-b82c-76326bbfd2b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.506s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '23230656466386533', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230656466386533', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[624f1c1c-be99-45d0-b557-8c014aa4ac0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcce6d5-084a-47fb-9473-13e7decc4066]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:42:30 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:30 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:42:30 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:30 user nova-compute[73079]:   <serial>4a126b6f-9390-435a-89a1-fa19e9b3e107</serial>
Aug 17 14:42:30 user nova-compute[73079]: </disk>
Aug 17 14:42:30 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e2be0-208c-44f5-8053-1fab2ace66b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:30 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b179dffa-05e2-4603-9e7b-14bcfc25f5e3]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG os_brick.utils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updating existing volume attachment record: 3b09d26e-cc91-4167-976f-c1d7ab39652d {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No VIF found with MAC fa:16:3e:44:20:b7, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:42:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:32 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283337.5017216, 48d1d41e-1443-498d-a54e-f7ce734e3089 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:42:32 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] VM Stopped (Lifecycle Event)
Aug 17 14:42:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b080c169-b872-4ffd-a8fb-cb17b5b1b303 None None] [instance: 48d1d41e-1443-498d-a54e-f7ce734e3089] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiVPTSXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:33 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db81a33-9420-42bb-b97f-e1c1502287c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:42:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdcf723-5feb-488f-a585-2eb189fc0b83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c] added
Aug 17 14:42:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6acaafad-d7e3-43d9-aee8-ae736c842ab8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.250s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72adce-3223-4e4b-80b2-108a76ab47ae]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70620d4-8097-42d1-b441-59d9a763566a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yiVPTSXd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yiVPTSXd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf579ea-874f-4619-9f4c-ea38d62e6e43]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yiVPTSXd'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[03914e2e-8bb4-4553-b81b-04d6373f8504]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4443c94c-4458-4076-9d16-da5a40ab169d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8fdeb-10cd-4ec9-b458-f1b92eb62ece]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260]
Aug 17 14:42:33 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f429a-b11e-4aad-b99a-15311a7d0cf2]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b4354f-06e2-4576-bcf5-d18c65948693]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:33 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:33 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547a6cf-3981-4035-9bd6-f6551e072068]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiVPTSXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-changed-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Refreshing instance network info cache due to event network-changed-a569bdf5-76c8-4976-972c-0587421bac2f. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] Acquiring lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] Acquired lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Refreshing network info cache for port a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73079) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lazy-loading 'flavor' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:34 user nova-compute[73079]: INFO nova.compute.manager [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Attaching volume a6eb5b43-fa2a-4256-af01-40c334ae380a to /dev/vdb
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.utils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9ecd7c-0376-495f-9eb4-75430091b80e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updated VIF entry in instance network info cache for port a569bdf5-76c8-4976-972c-0587421bac2f. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updating instance_info_cache with network_info: [{"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b623f8-8229-4aa9-a731-4e8e636211c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5578fb20-e29e-411d-a284-ffb77f394a94 req-3df12429-62a0-4ea5-994d-0f00ba69d3a9 service nova] Releasing lock "refresh_cache-42c5a511-402c-4712-a07e-1639512a7be9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7745eec-3381-4c7f-adb8-a74870f42558]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5536e5-cd16-4f03-b960-5f52ea267b46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:34 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[98542678-ed48-4eb8-b4c8-1cc55caae3d1]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.utils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updating existing volume attachment record: d6fb83fd-9722-4e45-ac60-d90a1214fa6f {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23032363034363731', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032363034363731', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'flavor' on Instance uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:42:34 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:34 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:42:34 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:34 user nova-compute[73079]:   <serial>1843e105-5de2-4c05-a712-8c7b6197b06c</serial>
Aug 17 14:42:34 user nova-compute[73079]: </disk>
Aug 17 14:42:34 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:42:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance destroyed successfully.
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No VIF found with MAC fa:16:3e:62:d3:d3, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1c07a549-8772-4e0b-aeb2-90f7917c8e21 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.235s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:35 user nova-compute[73079]: WARNING nova.compute.manager [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state None.
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:35 user nova-compute[73079]: WARNING nova.compute.manager [req-6c3c5ac5-a051-44bf-9641-1b1ddfb575ea req-15f301cf-316b-4e7d-aa28-ab948bc3f809 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state None.
Aug 17 14:42:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjFYqnhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:41 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[660bebce-ab32-46e3-85d9-5411a0a82a49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:42:41 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf307f-ec1d-4a4c-a96b-340e02473cef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf] added
Aug 17 14:42:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3746d3-9365-46f9-9ac5-8b15ac028015]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5beef01-62c0-4482-ae3a-e2f3a6ea9b3a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjFYqnhf {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjFYqnhf" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[318359ea-32a6-487f-bbd5-482550dc36cc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OjFYqnhf'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c45929fc-7abf-47ae-8dfc-b7e1dc1ad2b6 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.383s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a5d93-485f-4d80-86e2-161730359d06]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be934b-a72a-4e89-ac89-c3b3367c0200]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:42 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:42 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e214914b-686a-4937-b3a8-2b5b738a06f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260]
Aug 17 14:42:42 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730fabc-63b9-4826-9877-da290665d2e1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9a93d-625f-4e51-979f-bf84e26525b0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:42 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:42 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:42 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:42 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2437e3d3-f335-4b2a-83cb-7a6fc7298619]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjFYqnhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:42:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:43 user nova-compute[73079]: INFO nova.compute.manager [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Detaching volume 1843e105-5de2-4c05-a712-8c7b6197b06c
Aug 17 14:42:43 user nova-compute[73079]: INFO nova.virt.block_device [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Attempting to driver detach volume 1843e105-5de2-4c05-a712-8c7b6197b06c from mountpoint /dev/vdb
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Attempting to detach device vdb from instance a279bc96-247f-43e4-9d99-3dc690da4d0a from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:42:43 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:43 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:42:43 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:43 user nova-compute[73079]:   <serial>1843e105-5de2-4c05-a712-8c7b6197b06c</serial>
Aug 17 14:42:43 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:42:43 user nova-compute[73079]: </disk>
Aug 17 14:42:43 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:42:43 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Successfully detached device vdb from instance a279bc96-247f-43e4-9d99-3dc690da4d0a from the persistent domain config.
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a279bc96-247f-43e4-9d99-3dc690da4d0a from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:42:43 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:43 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:42:43 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:43 user nova-compute[73079]:   <serial>1843e105-5de2-4c05-a712-8c7b6197b06c</serial>
Aug 17 14:42:43 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:42:43 user nova-compute[73079]: </disk>
Aug 17 14:42:43 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26335316232666538', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335316232666538', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lazy-loading 'flavor' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 14:42:43 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:43 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:42:43 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:43 user nova-compute[73079]:   <serial>9f41cd27-4d84-4ed2-9682-854811fa07bf</serial>
Aug 17 14:42:43 user nova-compute[73079]: </disk>
Aug 17 14:42:43 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pelJhEdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:43 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:43 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:43 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89b7dc1-05b6-4e7c-b5a7-51a12a035905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:42:43 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f561969-6337-4b1f-951c-6ce32c520c41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78] added
Aug 17 14:42:43 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d508f-9a20-4c28-beb6-bf03b9ab9f07]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283364.016667, a279bc96-247f-43e4-9d99-3dc690da4d0a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7074ed10-e40a-4083-bbb1-1771c9fc0fac]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Successfully detached device vdb from instance a279bc96-247f-43e4-9d99-3dc690da4d0a from the live domain config.
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pelJhEdz {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yiVPTSXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:44 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pelJhEdz" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae1c18f-ab92-46bb-a3ff-e75b8f767ef2]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pelJhEdz'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d44892-ec9c-481a-8643-77e0c8988bf7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[131fa990-f246-46e2-8cdd-514745f30115]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] No VIF found with MAC fa:16:3e:b3:f8:77, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f9d90-90b8-4d96-bbe7-a59e446267d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260]
Aug 17 14:42:44 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f894dd50-3114-49b6-be59-7558890653d3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[40961f6f-c62b-45db-8b9d-14ef7b5a7b5b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:44 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7558249c-2353-4dbe-9e15-9121a59d4145]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pelJhEdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5ce541d-6bbe-4d77-8b6d-7f29c81d1980 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.663s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] volume_snapshot_create: create_info: {'snapshot_id': 'fc25f6f0-67bb-46b6-8680-8495b81537d5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73079) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] snap xml: <domainsnapshot>
Aug 17 14:42:44 user nova-compute[73079]:   <disks>
Aug 17 14:42:44 user nova-compute[73079]:     <disk name="/dev/sdd" snapshot="external" type="file">
Aug 17 14:42:44 user nova-compute[73079]:       <source file="/dev/new_file"/>
Aug 17 14:42:44 user nova-compute[73079]:     </disk>
Aug 17 14:42:44 user nova-compute[73079]:     <disk name="vda" snapshot="no"/>
Aug 17 14:42:44 user nova-compute[73079]:   </disks>
Aug 17 14:42:44 user nova-compute[73079]: </domainsnapshot>
Aug 17 14:42:44 user nova-compute[73079]:  {{(pid=73079) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.objects.instance [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lazy-loading 'system_metadata' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     rv = execute(f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     six.reraise(c, e, tb)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     raise value
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     rv = meth(*args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     self._volume_snapshot_create(context, instance, guest,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     rv = execute(f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     six.reraise(c, e, tb)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     raise value
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     rv = meth(*args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] 
Aug 17 14:42:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d4ccbcce-5e5d-4b50-86ba-3baaea97f414 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] volume_snapshot_delete: delete_info: {'volume_id': '9f41cd27-4d84-4ed2-9682-854811fa07bf'} {{(pid=73079) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [None req-d4ccbcce-5e5d-4b50-86ba-3baaea97f414 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5]     if delete_info['type'] != 'qcow2':
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] KeyError: 'type'
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot fc25f6f0-67bb-46b6-8680-8495b81537d5 could not be found.
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot fc25f6f0-67bb-46b6-8680-8495b81537d5 could not be found. (HTTP 404) (Request-ID: req-5d3b8faf-a317-4a55-bcec-fbb9509ac825)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot fc25f6f0-67bb-46b6-8680-8495b81537d5 could not be found.
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server [None req-daf48361-d3d0-4538-a1e2-8aaeeed5bf81 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver [None req-d4ccbcce-5e5d-4b50-86ba-3baaea97f414 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-b7c9bd53-bdb5-48bc-bd0d-12cb9f0372de)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 14:42:44 user nova-compute[73079]: ERROR nova.virt.libvirt.driver 
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server [None req-d4ccbcce-5e5d-4b50-86ba-3baaea97f414 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 14:42:44 user nova-compute[73079]: ERROR oslo_messaging.rpc.server 
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '23232333439393662', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232333439393662', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.419s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lazy-loading 'flavor' on Instance uuid 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f3bc0-30ac-4560-b0fb-b91c7c972def]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:42:45 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:45 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:42:45 user nova-compute[73079]:   <target dev="sdc" bus="scsi"/>
Aug 17 14:42:45 user nova-compute[73079]:   <serial>385fc141-105e-4955-8f99-69dc3e0efe78</serial>
Aug 17 14:42:45 user nova-compute[73079]:   <address type="drive" controller="0" unit="2"/>
Aug 17 14:42:45 user nova-compute[73079]: </disk>
Aug 17 14:42:45 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:42:45 user nova-compute[73079]: INFO nova.compute.manager [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Detaching volume 9f41cd27-4d84-4ed2-9682-854811fa07bf
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca75210-1533-4875-850c-3ad1aa3a6e6e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:45 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:45 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:45 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:45 user nova-compute[73079]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c (non-flash)
Aug 17 14:42:45 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:45 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8093520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c57e5a-df28-4691-9f66-82de0b227adc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: INFO nova.virt.block_device [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Attempting to driver detach volume 9f41cd27-4d84-4ed2-9682-854811fa07bf from mountpoint /dev/vdb
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9d84d8-9ebd-4a8a-be6f-0ae443dbd95e]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c0be4-cc34-4d58-b3d7-a3c94a3f0a2c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Attempting to detach device vdb from instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 14:42:45 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:45 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:42:45 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:45 user nova-compute[73079]:   <serial>9f41cd27-4d84-4ed2-9682-854811fa07bf</serial>
Aug 17 14:42:45 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:42:45 user nova-compute[73079]: </disk>
Aug 17 14:42:45 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Successfully detached device vdb from instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 from the persistent domain config.
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 14:42:45 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:45 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:42:45 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:45 user nova-compute[73079]:   <serial>9f41cd27-4d84-4ed2-9682-854811fa07bf</serial>
Aug 17 14:42:45 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:42:45 user nova-compute[73079]: </disk>
Aug 17 14:42:45 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d04c230-0fa3-4a47-94d4-800d19a9cf0e]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[05188e55-89fc-47d9-9097-69a279db1baa]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd02e8f3-376b-40d5-9a43-0c59a365417f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260]
Aug 17 14:42:45 user nova-compute[73079]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1843e105-5de2-4c05-a712-8c7b6197b06c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01fe99-c8c5-4109-b056-891192e1a0f5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] <== disconnect_volume: return (1726ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No BDM found with device name sda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] No VIF found with MAC fa:16:3e:0c:c1:1f, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7a067351-516b-49c2-8401-19301d78a38b tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.636s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283366.1876044, fc221fd3-a333-4a8e-8d14-d273c3f292e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:42:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Successfully detached device vdb from instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 from the live domain config.
Aug 17 14:42:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjFYqnhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0917c4-af18-4147-b038-ba071f57da7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a5009-f136-403b-b844-7b7e0e5b6a2e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e823a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4a30f-59db-4320-b6ec-6332bd2c456c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a10a1d6-b65c-4314-9b01-c7e98702b780]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[588c16a4-26f6-485c-a724-6edf8b3ccdd2]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8239500-ebfb-4eab-9fac-d57b4f6bbe27]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[68493885-eba2-484d-894c-c1caa4ceb156]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba0c220-84aa-4a10-8918-7bd50fd6c9aa]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260]
Aug 17 14:42:46 user nova-compute[73079]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f41cd27-4d84-4ed2-9682-854811fa07bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac50f1-38ae-4cdb-a5d5-580bbf254d3f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] <== disconnect_volume: return (307ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:46 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997d145-841b-4591-92fd-5b4955b53597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:42:46 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924dba5-b055-4678-87f6-9b51d19af147]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a] added
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b672403-96ba-4196-ba54-d8b11adc51aa]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5582c2a1-378b-4ffa-97ff-9d3a07252315]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfsOVyHF {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfsOVyHF" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5253f-ac64-4944-bcd3-bf90e7cc57de]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SfsOVyHF'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a362c5c-8fa7-4ed2-a31c-3ddb098e4a8e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556d46c-7df2-40ec-9541-5a1b810000cd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e7f06-5561-42e8-bd35-9961fc3f1b14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]
Aug 17 14:42:46 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b789810-2642-4291-9a25-0da7ad181227]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3609ad-5ac6-4972-8fff-1c8ed08c9ccf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:46 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:42:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6954c2-4930-407f-aac5-473febbd2343]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:42:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:47 user nova-compute[73079]: INFO nova.compute.manager [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Detaching volume 385fc141-105e-4955-8f99-69dc3e0efe78
Aug 17 14:42:47 user nova-compute[73079]: INFO nova.virt.block_device [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Attempting to driver detach volume 385fc141-105e-4955-8f99-69dc3e0efe78 from mountpoint /dev/sdc
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Attempting to detach device sdc from instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:42:47 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:47 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:42:47 user nova-compute[73079]:   <target dev="sdc" bus="scsi"/>
Aug 17 14:42:47 user nova-compute[73079]:   <serial>385fc141-105e-4955-8f99-69dc3e0efe78</serial>
Aug 17 14:42:47 user nova-compute[73079]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 14:42:47 user nova-compute[73079]: </disk>
Aug 17 14:42:47 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:42:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Successfully detached device sdc from instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 from the persistent domain config.
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:42:47 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:47 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:42:47 user nova-compute[73079]:   <target dev="sdc" bus="scsi"/>
Aug 17 14:42:47 user nova-compute[73079]:   <serial>385fc141-105e-4955-8f99-69dc3e0efe78</serial>
Aug 17 14:42:47 user nova-compute[73079]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 14:42:47 user nova-compute[73079]: </disk>
Aug 17 14:42:47 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'flavor' on Instance uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lazy-loading 'flavor' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1a8e058b-ba7d-4a6c-85ad-74e869240330 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.472s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90239a5f-e7e0-4caf-b960-8f9ca7c0b107 tempest-VolumesAssistedSnapshotsTest-1727183655 tempest-VolumesAssistedSnapshotsTest-1727183655-project-admin] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.088s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283367.7299893, 04afdcd0-4876-4227-84f6-b2dcf8e041f4 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:42:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Successfully detached device sdc from instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4 from the live domain config.
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pelJhEdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:47 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26634633065373636', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633065373636', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.181s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lazy-loading 'flavor' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd730177-d08b-4174-a1cc-449e314e6c90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:42:47 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:42:47 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:42:47 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:42:47 user nova-compute[73079]:   <serial>a6eb5b43-fa2a-4256-af01-40c334ae380a</serial>
Aug 17 14:42:47 user nova-compute[73079]: </disk>
Aug 17 14:42:47 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6aa30-4f39-428e-925f-e87c1c440921]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:47 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:47 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:42:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:42:47 user nova-compute[73079]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 (non-flash)
Aug 17 14:42:47 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:42:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82f3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640a89f-dc71-4d0d-a58b-5bba22c8af56]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[274db05a-4852-4c3a-ac86-672f9958ac52]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b03c6-e63b-41f9-b314-b420d7762973]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd10d8-3033-4510-b245-ece587eb72d2]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa1986-78e7-4197-a919-9ffd049d2ad7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e1a85-364d-496a-afdc-5e7e15244630]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260]
Aug 17 14:42:48 user nova-compute[73079]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78, portal: 172.16.0.220,3260] successful.
Aug 17 14:42:48 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:385fc141-105e-4955-8f99-69dc3e0efe78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[32248f7e-70f5-42ac-8998-35f409b59272]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] <== disconnect_volume: return (453ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] No VIF found with MAC fa:16:3e:ff:bc:39, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:42:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1407d6ed-582e-4142-885f-e5efb40c2f07 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.029s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lazy-loading 'flavor' on Instance uuid 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-70b15a8e-fb41-4d14-bb0e-16818fe4f671 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.859s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG os_brick.utils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1856c870-af78-41ca-88fc-4e7413998cdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb05e9-bb76-4c63-ae20-0c716abc30fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[23beff29-7ebd-4f8f-99b0-8a7c87d75858]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1414c70c-dcb4-44d9-adf2-6770590f02da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:42:49 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2d18e-5a40-4de7-a2ff-c268861477d0]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG os_brick.utils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:42:49 user nova-compute[73079]: INFO nova.compute.manager [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Swapping volume a6eb5b43-fa2a-4256-af01-40c334ae380a for f0c9e7de-197c-4802-85b6-4b07e5c7e216
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:49 user nova-compute[73079]: INFO nova.compute.manager [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Terminating instance
Aug 17 14:42:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283355.1470482, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:42:50 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Stopped (Lifecycle Event)
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1dfbde58-35bc-4311-83ee-751cbf98d09a None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1dfbde58-35bc-4311-83ee-751cbf98d09a None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-bb58d637-21fc-4feb-8b1a-48e40544b74e req-b48e553d-431a-4c1e-9f5f-7f5e627be0ac service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-vif-unplugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bb58d637-21fc-4feb-8b1a-48e40544b74e req-b48e553d-431a-4c1e-9f5f-7f5e627be0ac service nova] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bb58d637-21fc-4feb-8b1a-48e40544b74e req-b48e553d-431a-4c1e-9f5f-7f5e627be0ac service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bb58d637-21fc-4feb-8b1a-48e40544b74e req-b48e553d-431a-4c1e-9f5f-7f5e627be0ac service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-bb58d637-21fc-4feb-8b1a-48e40544b74e req-b48e553d-431a-4c1e-9f5f-7f5e627be0ac service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] No waiting events found dispatching network-vif-unplugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-bb58d637-21fc-4feb-8b1a-48e40544b74e req-b48e553d-431a-4c1e-9f5f-7f5e627be0ac service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-vif-unplugged-2fc84308-85e4-4b78-95f6-4a9df66f466a for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:42:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Instance destroyed successfully.
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lazy-loading 'resources' on Instance uuid 04afdcd0-4876-4227-84f6-b2dcf8e041f4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1186106875',display_name='tempest-AttachSCSIVolumeTestJSON-server-1186106875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1186106875',id=7,image_ref='b6ed9d48-cb7b-411b-8805-d089c2e0efec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAMRPfSLUW4YfmgK1Vx60/b+5O89azLeohdN0AwXrrECUbkfWGN4A0pYuWp8l/N6oa/m4VRTj2RG33Lmw9mUgasPg+L43bPFlk2ojrVNFOhuZlklU7mH3hOgBcxhPnCsw==',key_name='tempest-keypair-1640666655',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9587f77ba47d4d02b3a8068289959ec1',ramdisk_id='',reservation_id='r-fk6si0tz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b6ed9d48-cb7b-411b-8805-d089c2e0efec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-87643929',owner_user_name='tempest-AttachSCSIVolumeTestJSON-87643929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b3396b0c854e4aa6ab6fef1874793d',uuid=04afdcd0-4876-4227-84f6-b2dcf8e041f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Converting VIF {"id": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "address": "fa:16:3e:0c:c1:1f", "network": {"id": "28d57bea-89fd-40ac-bff1-f22c0d76a158", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-886126278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9587f77ba47d4d02b3a8068289959ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc84308-85", "ovs_interfaceid": "2fc84308-85e4-4b78-95f6-4a9df66f466a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG os_vif [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fc84308-85, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:50 user nova-compute[73079]: INFO os_vif [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c1:1f,bridge_name='br-int',has_traffic_filtering=True,id=2fc84308-85e4-4b78-95f6-4a9df66f466a,network=Network(28d57bea-89fd-40ac-bff1-f22c0d76a158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc84308-85')
Aug 17 14:42:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Deleting instance files /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4_del
Aug 17 14:42:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Deletion of /opt/stack/data/nova/instances/04afdcd0-4876-4227-84f6-b2dcf8e041f4_del complete
Aug 17 14:42:50 user nova-compute[73079]: INFO nova.compute.manager [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 14:42:50 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:42:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:51 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:51 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Took 0.89 seconds to deallocate network for instance.
Aug 17 14:42:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:51 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:52 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Deleted allocations for instance 04afdcd0-4876-4227-84f6-b2dcf8e041f4
Aug 17 14:42:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c3ae491-1b03-4588-80d1-cd54b0163bc3 tempest-AttachSCSIVolumeTestJSON-87643929 tempest-AttachSCSIVolumeTestJSON-87643929-project-member] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] Acquiring lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] Lock "04afdcd0-4876-4227-84f6-b2dcf8e041f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] No waiting events found dispatching network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:42:52 user nova-compute[73079]: WARNING nova.compute.manager [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received unexpected event network-vif-plugged-2fc84308-85e4-4b78-95f6-4a9df66f466a for instance with vm_state deleted and task_state None.
Aug 17 14:42:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-d33a3adc-ea83-48de-8c38-96f747cb6613 req-7d1404a1-539b-4ec4-b1ad-51a6a50ace95 service nova] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Received event network-vif-deleted-2fc84308-85e4-4b78-95f6-4a9df66f466a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:42:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:42:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:42:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:42:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:43:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:43:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:43:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7465MB free_disk=25.637771606445312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a279bc96-247f-43e4-9d99-3dc690da4d0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance fc221fd3-a333-4a8e-8d14-d273c3f292e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 42c5a511-402c-4712-a07e-1639512a7be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cb8ad507-b5da-467c-8008-f43573b7e7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 5e196ca7-2142-4c24-b3fe-800e360cbe49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:43:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283370.5603151, 04afdcd0-4876-4227-84f6-b2dcf8e041f4 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:43:05 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] VM Stopped (Lifecycle Event)
Aug 17 14:43:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f3830523-6efd-48e0-a975-ffc65430fa7b None None] [instance: 04afdcd0-4876-4227-84f6-b2dcf8e041f4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:43:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWoXetv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42c5a511-402c-4712-a07e-1639512a7be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216', 'serial': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '42c5a511-402c-4712-a07e-1639512a7be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6eb5b43-fa2a-4256-af01-40c334ae380a', 'serial'} {{(pid=73079) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWoXetv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:12 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5826202-6f27-4224-acb0-2e7c06c9a143]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:43:12 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebd9827-dc15-4c01-85e7-e4410b6ef46c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216] added
Aug 17 14:43:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fc7207-8423-4400-80c0-92108bfeb8ec]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[92920325-d17d-4498-9f03-b52cb32f7290]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COWoXetv {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COWoXetv" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf0665-22ef-4e01-b0de-67f8efa91e09]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'COWoXetv'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba58c2e-a310-4c05-80b0-8af676251e94]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44ed78-84ea-48b9-ab5e-45b81b55b65a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:12 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:12 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf44796-7f4d-4921-ba23-0e421360c074]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260]
Aug 17 14:43:12 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260] successful.
Aug 17 14:43:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a7df2-a281-4b9e-8f55-1dbcb7bb8af0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba53bc2-7f9b-4d91-9a3c-0f375f20d6ad]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:13 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:13 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:13 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:13 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:13 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:13 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cfe915-41a6-42ad-a0d3-67510110e63b]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:13 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWoXetv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23361353964633530', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361353964633530', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lazy-loading 'flavor' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 286261248 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 463470592 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 629145600 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 763363328 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 941621248 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:18 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ef4f6-1ecb-4ebd-b664-863bd22f80ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197169f-e4aa-48b5-9e16-fbe0c8346688]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:18 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:18 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:18 user nova-compute[73079]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:18 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8093f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7074b0-2462-4395-b1e2-746ac1be8acb]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd900f44-7946-43d4-873f-cd8bddbd6a01]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d93d566-4b12-49a2-930c-432b9f32cd46]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7499014f-a221-42aa-ac21-a69b98fe4dce]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b3ce18-bd37-42e9-b8c3-b6769abe440f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0c4af6-4b1b-4a9c-9a7d-b69889735517]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]
Aug 17 14:43:18 user nova-compute[73079]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.
Aug 17 14:43:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbea88c-7223-482c-ae40-6b2497ee7686]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] <== disconnect_volume: return (303ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWoXetv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '42c5a511-402c-4712-a07e-1639512a7be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216', 'serial'} {{(pid=73079) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 14:43:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] swap_volume: removing Cinder connection for volume a6eb5b43-fa2a-4256-af01-40c334ae380a {{(pid=73079) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 14:43:19 user nova-compute[73079]: DEBUG nova.compute.manager [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] swap_volume: Updating volume a6eb5b43-fa2a-4256-af01-40c334ae380a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "COWoXetv", "auth_password": "LU9PuWErcmZF2A", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "f0c9e7de-197c-4802-85b6-4b07e5c7e216"}, "status": "reserved", "instance": "42c5a511-402c-4712-a07e-1639512a7be9", "attached_at": "", "detached_at": "", "volume_id": "f0c9e7de-197c-4802-85b6-4b07e5c7e216", "serial": "f0c9e7de-197c-4802-85b6-4b07e5c7e216"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216', 'no_device': None, 'attachment_id': 'dc345c8f-7d61-43fb-a3c6-f5b80aad7837'} {{(pid=73079) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 14:43:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-64fc3518-2149-4075-bfae-90ef45473e9e tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.051s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG os_brick.utils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226fe6a-4e2b-4d00-a693-2bb5bdb297fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d436d-450d-48fb-b748-5211bbee62bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7830a2f4-3a54-471e-bdd7-1004dde39293]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8211de22-0ed5-4c18-bb13-9e54bc7ea49f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:20 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:43:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[050347ae-6eec-4a01-833d-50319a93ab29]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:43:20 user nova-compute[73079]: DEBUG os_brick.utils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:20 user nova-compute[73079]: INFO nova.compute.manager [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Swapping volume f0c9e7de-197c-4802-85b6-4b07e5c7e216 for a6eb5b43-fa2a-4256-af01-40c334ae380a
Aug 17 14:43:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:43:30 user nova-compute[73079]: INFO nova.compute.claims [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Claim successful on node user
Aug 17 14:43:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:43:31 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.policy [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb1feccca7d645ac90dff8f481bfe139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0da7dcf51b4267a38083a278e58ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:43:31 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Creating image(s)
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk 1073741824" returned: 0 in 0.065s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.219s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:43:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Successfully created port: 38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Cannot resize image /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'migration_context' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Ensure instance console log exists: /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42c5a511-402c-4712-a07e-1639512a7be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6eb5b43-fa2a-4256-af01-40c334ae380a', 'serial': 'a6eb5b43-fa2a-4256-af01-40c334ae380a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWoXetv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216'}, 'status': 'reserved', 'instance': '42c5a511-402c-4712-a07e-1639512a7be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216', 'serial'} {{(pid=73079) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:32 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:32 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:32 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ed34b6-9d18-4c59-9503-4251298f6e44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:43:32 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ddce35-d35e-4bec-8c12-564bea51245c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a] added
Aug 17 14:43:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4529b3d-5d84-494a-97e9-6e2e47ec6c58]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52de56-48ba-428f-8bdd-894a88cfd5d4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfsOVyHF {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfsOVyHF" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[72390150-e403-4da4-9ff5-c1b80b55cb10]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SfsOVyHF'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae18dfa2-5e11-40e3-86c2-6fcce3679e54]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101cad3-c868-40e7-9ec6-714c5613a97a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67c570-a6ee-4337-8a4a-0d513a9b5c0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]
Aug 17 14:43:32 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.
Aug 17 14:43:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed795d5-353b-4f8e-add3-1743258e81e9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a4dd6-1d99-482f-bc85-6d83a83e9c25]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:32 user nova-compute[73079]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc9f47-ecda-4261-bf88-d7a69c87e709]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Successfully updated port: 38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-changed-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing instance network info cache due to event network-changed-38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:43:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance network_info: |[{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Start _get_guest_xml network_info=[{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:43:33 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:43:33 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1662234110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1662234110',id=12,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEilashB2BPL+es6WZoI8bJdKCPPyqoAL9bLN6jMjig7DSRb+5ktF80nPIgKjR1+keFKd+VUCMuVzSbEmj0FdeA0GkPBJ8wiruIQMze7tZ3+8USog9SCui1puZNu/HxxnQ==',key_name='tempest-keypair-1562296241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-ufol2uj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=dcef5f40-f1b3-4fcb-8875-c8e749fc63c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'pci_devices' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:43:33 user nova-compute[73079]:   <uuid>dcef5f40-f1b3-4fcb-8875-c8e749fc63c1</uuid>
Aug 17 14:43:33 user nova-compute[73079]:   <name>instance-0000000c</name>
Aug 17 14:43:33 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:43:33 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:43:33 user nova-compute[73079]:   <metadata>
Aug 17 14:43:33 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:43:33 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:43:33 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1662234110</nova:name>
Aug 17 14:43:33 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:43:33</nova:creationTime>
Aug 17 14:43:33 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:43:33 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:43:33 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:43:33 user nova-compute[73079]:       <nova:owner>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:user uuid="bb1feccca7d645ac90dff8f481bfe139">tempest-AttachVolumeShelveTestJSON-474259075-project-member</nova:user>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:project uuid="eb0da7dcf51b4267a38083a278e58ef9">tempest-AttachVolumeShelveTestJSON-474259075</nova:project>
Aug 17 14:43:33 user nova-compute[73079]:       </nova:owner>
Aug 17 14:43:33 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:43:33 user nova-compute[73079]:       <nova:ports>
Aug 17 14:43:33 user nova-compute[73079]:         <nova:port uuid="38eb71bf-50d8-4510-930a-6060b894242d">
Aug 17 14:43:33 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 14:43:33 user nova-compute[73079]:         </nova:port>
Aug 17 14:43:33 user nova-compute[73079]:       </nova:ports>
Aug 17 14:43:33 user nova-compute[73079]:     </nova:instance>
Aug 17 14:43:33 user nova-compute[73079]:   </metadata>
Aug 17 14:43:33 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:43:33 user nova-compute[73079]:     <system>
Aug 17 14:43:33 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:43:33 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:43:33 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:43:33 user nova-compute[73079]:       <entry name="serial">dcef5f40-f1b3-4fcb-8875-c8e749fc63c1</entry>
Aug 17 14:43:33 user nova-compute[73079]:       <entry name="uuid">dcef5f40-f1b3-4fcb-8875-c8e749fc63c1</entry>
Aug 17 14:43:33 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:43:33 user nova-compute[73079]:     </system>
Aug 17 14:43:33 user nova-compute[73079]:   </sysinfo>
Aug 17 14:43:33 user nova-compute[73079]:   <os>
Aug 17 14:43:33 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:43:33 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:43:33 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:43:33 user nova-compute[73079]:   </os>
Aug 17 14:43:33 user nova-compute[73079]:   <features>
Aug 17 14:43:33 user nova-compute[73079]:     <acpi/>
Aug 17 14:43:33 user nova-compute[73079]:     <apic/>
Aug 17 14:43:33 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:43:33 user nova-compute[73079]:   </features>
Aug 17 14:43:33 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:43:33 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:43:33 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:43:33 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:43:33 user nova-compute[73079]:   </clock>
Aug 17 14:43:33 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:43:33 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:43:33 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:43:33 user nova-compute[73079]:   </cpu>
Aug 17 14:43:33 user nova-compute[73079]:   <devices>
Aug 17 14:43:33 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:43:33 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:43:33 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk"/>
Aug 17 14:43:33 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:43:33 user nova-compute[73079]:     </disk>
Aug 17 14:43:33 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:43:33 user nova-compute[73079]:       <mac address="fa:16:3e:a2:28:f2"/>
Aug 17 14:43:33 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:43:33 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:43:33 user nova-compute[73079]:       <target dev="tap38eb71bf-50"/>
Aug 17 14:43:33 user nova-compute[73079]:     </interface>
Aug 17 14:43:33 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:43:33 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/console.log" append="off"/>
Aug 17 14:43:33 user nova-compute[73079]:     </serial>
Aug 17 14:43:33 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:43:33 user nova-compute[73079]:     <video>
Aug 17 14:43:33 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:43:33 user nova-compute[73079]:     </video>
Aug 17 14:43:33 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:43:33 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:43:33 user nova-compute[73079]:     </rng>
Aug 17 14:43:33 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:43:33 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:43:33 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:43:33 user nova-compute[73079]:     </memballoon>
Aug 17 14:43:33 user nova-compute[73079]:   </devices>
Aug 17 14:43:33 user nova-compute[73079]: </domain>
Aug 17 14:43:33 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1662234110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1662234110',id=12,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEilashB2BPL+es6WZoI8bJdKCPPyqoAL9bLN6jMjig7DSRb+5ktF80nPIgKjR1+keFKd+VUCMuVzSbEmj0FdeA0GkPBJ8wiruIQMze7tZ3+8USog9SCui1puZNu/HxxnQ==',key_name='tempest-keypair-1562296241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-ufol2uj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=dcef5f40-f1b3-4fcb-8875-c8e749fc63c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG os_vif [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38eb71bf-50, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38eb71bf-50, col_values=(('external_ids', {'iface-id': '38eb71bf-50d8-4510-930a-6060b894242d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:28:f2', 'vm-uuid': 'dcef5f40-f1b3-4fcb-8875-c8e749fc63c1'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:33 user nova-compute[73079]: INFO os_vif [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50')
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No VIF found with MAC fa:16:3e:a2:28:f2, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26634633065373636', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634633065373636', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lazy-loading 'flavor' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updated VIF entry in instance network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d11c9dbe-983f-4162-b187-dc726b5390e4 req-ab10bf0e-fda6-4470-91f1-b7f3260f625a service nova] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "89cd463e-6624-4963-8007-aa6094f7e890" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:43:34 user nova-compute[73079]: INFO nova.compute.claims [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Claim successful on node user
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 293601280 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:43:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-c83d24c3-0dd8-49b6-ae4d-7a1640a31a56 req-5127f915-b6e5-4827-9ce9-630343406efd service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c83d24c3-0dd8-49b6-ae4d-7a1640a31a56 req-5127f915-b6e5-4827-9ce9-630343406efd service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c83d24c3-0dd8-49b6-ae4d-7a1640a31a56 req-5127f915-b6e5-4827-9ce9-630343406efd service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c83d24c3-0dd8-49b6-ae4d-7a1640a31a56 req-5127f915-b6e5-4827-9ce9-630343406efd service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-c83d24c3-0dd8-49b6-ae4d-7a1640a31a56 req-5127f915-b6e5-4827-9ce9-630343406efd service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:35 user nova-compute[73079]: WARNING nova.compute.manager [req-c83d24c3-0dd8-49b6-ae4d-7a1640a31a56 req-5127f915-b6e5-4827-9ce9-630343406efd service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state building and task_state spawning.
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.policy [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0e2a779916a4463a819fa223bb0af42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3cf39349f140cb962abc3857c8b7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:43:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Creating image(s)
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "/opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "/opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 439353344 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.266s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk 1073741824" returned: 0 in 0.082s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 592445440 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Successfully created port: c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.260s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Cannot resize image /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'migration_context' on Instance uuid 89cd463e-6624-4963-8007-aa6094f7e890 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Ensure instance console log exists: /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 747634688 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 932184064 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Successfully updated port: c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "refresh_cache-89cd463e-6624-4963-8007-aa6094f7e890" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquired lock "refresh_cache-89cd463e-6624-4963-8007-aa6094f7e890" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-2df28366-df02-4410-95ab-3fb00df28274 req-e459f622-de06-49f1-89a2-551b0ad33e27 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2df28366-df02-4410-95ab-3fb00df28274 req-e459f622-de06-49f1-89a2-551b0ad33e27 service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2df28366-df02-4410-95ab-3fb00df28274 req-e459f622-de06-49f1-89a2-551b0ad33e27 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2df28366-df02-4410-95ab-3fb00df28274 req-e459f622-de06-49f1-89a2-551b0ad33e27 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-2df28366-df02-4410-95ab-3fb00df28274 req-e459f622-de06-49f1-89a2-551b0ad33e27 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:37 user nova-compute[73079]: WARNING nova.compute.manager [req-2df28366-df02-4410-95ab-3fb00df28274 req-e459f622-de06-49f1-89a2-551b0ad33e27 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state building and task_state spawning.
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283417.8104966, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:43:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] VM Resumed (Lifecycle Event)
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:43:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance spawned successfully.
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:43:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283417.815006, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:43:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] VM Started (Lifecycle Event)
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:43:37 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:43:37 user nova-compute[73079]: INFO nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:43:38 user nova-compute[73079]: INFO nova.compute.manager [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Took 7.50 seconds to build instance.
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Updating instance_info_cache with network_info: [{"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c586b362-3c9f-469b-b058-f92e69eb63e1 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.624s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Releasing lock "refresh_cache-89cd463e-6624-4963-8007-aa6094f7e890" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Instance network_info: |[{"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Start _get_guest_xml network_info=[{"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:43:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:43:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:43:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-593568480',display_name='tempest-VolumesAdminNegativeTest-server-593568480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-593568480',id=13,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3cf39349f140cb962abc3857c8b7c0',ramdisk_id='',reservation_id='r-0xn6znb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-385938588',owner_user_name='tempest-VolumesAdminNegativeTest-385938588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:43:36Z,user_data=None,user_id='a0e2a779916a4463a819fa223bb0af42',uuid=89cd463e-6624-4963-8007-aa6094f7e890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converting VIF {"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cd463e-6624-4963-8007-aa6094f7e890 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:43:38 user nova-compute[73079]:   <uuid>89cd463e-6624-4963-8007-aa6094f7e890</uuid>
Aug 17 14:43:38 user nova-compute[73079]:   <name>instance-0000000d</name>
Aug 17 14:43:38 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:43:38 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:43:38 user nova-compute[73079]:   <metadata>
Aug 17 14:43:38 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:43:38 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:43:38 user nova-compute[73079]:       <nova:name>tempest-VolumesAdminNegativeTest-server-593568480</nova:name>
Aug 17 14:43:38 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:43:38</nova:creationTime>
Aug 17 14:43:38 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:43:38 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:43:38 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:43:38 user nova-compute[73079]:       <nova:owner>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:user uuid="a0e2a779916a4463a819fa223bb0af42">tempest-VolumesAdminNegativeTest-385938588-project-member</nova:user>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:project uuid="fd3cf39349f140cb962abc3857c8b7c0">tempest-VolumesAdminNegativeTest-385938588</nova:project>
Aug 17 14:43:38 user nova-compute[73079]:       </nova:owner>
Aug 17 14:43:38 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:43:38 user nova-compute[73079]:       <nova:ports>
Aug 17 14:43:38 user nova-compute[73079]:         <nova:port uuid="c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1">
Aug 17 14:43:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 14:43:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:43:38 user nova-compute[73079]:       </nova:ports>
Aug 17 14:43:38 user nova-compute[73079]:     </nova:instance>
Aug 17 14:43:38 user nova-compute[73079]:   </metadata>
Aug 17 14:43:38 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:43:38 user nova-compute[73079]:     <system>
Aug 17 14:43:38 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:43:38 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:43:38 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:43:38 user nova-compute[73079]:       <entry name="serial">89cd463e-6624-4963-8007-aa6094f7e890</entry>
Aug 17 14:43:38 user nova-compute[73079]:       <entry name="uuid">89cd463e-6624-4963-8007-aa6094f7e890</entry>
Aug 17 14:43:38 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:43:38 user nova-compute[73079]:     </system>
Aug 17 14:43:38 user nova-compute[73079]:   </sysinfo>
Aug 17 14:43:38 user nova-compute[73079]:   <os>
Aug 17 14:43:38 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:43:38 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:43:38 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:43:38 user nova-compute[73079]:   </os>
Aug 17 14:43:38 user nova-compute[73079]:   <features>
Aug 17 14:43:38 user nova-compute[73079]:     <acpi/>
Aug 17 14:43:38 user nova-compute[73079]:     <apic/>
Aug 17 14:43:38 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:43:38 user nova-compute[73079]:   </features>
Aug 17 14:43:38 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:43:38 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:43:38 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:43:38 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:43:38 user nova-compute[73079]:   </clock>
Aug 17 14:43:38 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:43:38 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:43:38 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:43:38 user nova-compute[73079]:   </cpu>
Aug 17 14:43:38 user nova-compute[73079]:   <devices>
Aug 17 14:43:38 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:43:38 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:43:38 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk"/>
Aug 17 14:43:38 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:43:38 user nova-compute[73079]:     </disk>
Aug 17 14:43:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:43:38 user nova-compute[73079]:       <mac address="fa:16:3e:a7:10:32"/>
Aug 17 14:43:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:43:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:43:38 user nova-compute[73079]:       <target dev="tapc8ccf611-f9"/>
Aug 17 14:43:38 user nova-compute[73079]:     </interface>
Aug 17 14:43:38 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:43:38 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/console.log" append="off"/>
Aug 17 14:43:38 user nova-compute[73079]:     </serial>
Aug 17 14:43:38 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:43:38 user nova-compute[73079]:     <video>
Aug 17 14:43:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:43:38 user nova-compute[73079]:     </video>
Aug 17 14:43:38 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:43:38 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:43:38 user nova-compute[73079]:     </rng>
Aug 17 14:43:38 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:43:38 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:43:38 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:43:38 user nova-compute[73079]:     </memballoon>
Aug 17 14:43:38 user nova-compute[73079]:   </devices>
Aug 17 14:43:38 user nova-compute[73079]: </domain>
Aug 17 14:43:38 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:43:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-593568480',display_name='tempest-VolumesAdminNegativeTest-server-593568480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-593568480',id=13,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3cf39349f140cb962abc3857c8b7c0',ramdisk_id='',reservation_id='r-0xn6znb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-385938588',owner_user_name='tempest-VolumesAdminNegativeTest-385938588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:43:36Z,user_data=None,user_id='a0e2a779916a4463a819fa223bb0af42',uuid=89cd463e-6624-4963-8007-aa6094f7e890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converting VIF {"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_vif [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8ccf611-f9, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8ccf611-f9, col_values=(('external_ids', {'iface-id': 'c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:10:32', 'vm-uuid': '89cd463e-6624-4963-8007-aa6094f7e890'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWoXetv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'f0c9e7de-197c-4802-85b6-4b07e5c7e216'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:38 user nova-compute[73079]: INFO os_vif [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9')
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[256441e0-adf7-4826-8444-7cdb8ac768ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a5f368-10d1-48bb-ab16-06d9e267d41f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:38 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:38 user nova-compute[73079]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:38 user nova-compute[73079]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 (non-flash)
Aug 17 14:43:38 user nova-compute[73079]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e85444c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] No VIF found with MAC fa:16:3e:a7:10:32, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a08599-7a4d-4c91-ab86-70d5627f2a83]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e531a65-66d5-49ae-81d5-4c470dce4850]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfa103d-4ec7-4e58-a96f-2a306872d4ce]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d454ddf3-c740-4d77-b7d1-a7083b73af93]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0b1b2-e61f-4eeb-b94c-4f0b9bed57bb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d25cc9-12f2-4328-95c9-7234150eeb8e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260]
Aug 17 14:43:38 user nova-compute[73079]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216, portal: 172.16.0.220,3260] successful.
Aug 17 14:43:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0c9e7de-197c-4802-85b6-4b07e5c7e216 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d0e6d-d19f-4767-9419-ae263768b55b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] <== disconnect_volume: return (291ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '42c5a511-402c-4712-a07e-1639512a7be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6eb5b43-fa2a-4256-af01-40c334ae380a', 'serial'} {{(pid=73079) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 14:43:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] swap_volume: removing Cinder connection for volume f0c9e7de-197c-4802-85b6-4b07e5c7e216 {{(pid=73079) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] swap_volume: Updating volume f0c9e7de-197c-4802-85b6-4b07e5c7e216 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "SfsOVyHF", "auth_password": "6DJqZAuaWVH0E1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "a6eb5b43-fa2a-4256-af01-40c334ae380a"}, "status": "reserved", "instance": "42c5a511-402c-4712-a07e-1639512a7be9", "attached_at": "", "detached_at": "", "volume_id": "a6eb5b43-fa2a-4256-af01-40c334ae380a", "serial": "a6eb5b43-fa2a-4256-af01-40c334ae380a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a6eb5b43-fa2a-4256-af01-40c334ae380a', 'no_device': None, 'attachment_id': '5cade71a-663f-4af8-bc08-c5b86a1da1de'} {{(pid=73079) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd5c2a87-3a08-4b81-aa0d-56975f381115 tempest-TestVolumeSwap-934727149 tempest-TestVolumeSwap-934727149-project-admin] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.259s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-changed-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Refreshing instance network info cache due to event network-changed-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] Acquiring lock "refresh_cache-89cd463e-6624-4963-8007-aa6094f7e890" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] Acquired lock "refresh_cache-89cd463e-6624-4963-8007-aa6094f7e890" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG nova.network.neutron [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Refreshing network info cache for port c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6378688-7ac4-49b7-a30d-eee8f3101c6a req-4ac200c4-9e29-4756-86aa-99eae6e100a7 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6378688-7ac4-49b7-a30d-eee8f3101c6a req-4ac200c4-9e29-4756-86aa-99eae6e100a7 service nova] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6378688-7ac4-49b7-a30d-eee8f3101c6a req-4ac200c4-9e29-4756-86aa-99eae6e100a7 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6378688-7ac4-49b7-a30d-eee8f3101c6a req-4ac200c4-9e29-4756-86aa-99eae6e100a7 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6378688-7ac4-49b7-a30d-eee8f3101c6a req-4ac200c4-9e29-4756-86aa-99eae6e100a7 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] No waiting events found dispatching network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:39 user nova-compute[73079]: WARNING nova.compute.manager [req-b6378688-7ac4-49b7-a30d-eee8f3101c6a req-4ac200c4-9e29-4756-86aa-99eae6e100a7 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received unexpected event network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 for instance with vm_state building and task_state spawning.
Aug 17 14:43:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:40 user nova-compute[73079]: INFO nova.compute.manager [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Detaching volume a6eb5b43-fa2a-4256-af01-40c334ae380a
Aug 17 14:43:40 user nova-compute[73079]: INFO nova.virt.block_device [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Attempting to driver detach volume a6eb5b43-fa2a-4256-af01-40c334ae380a from mountpoint /dev/vdb
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Attempting to detach device vdb from instance 42c5a511-402c-4712-a07e-1639512a7be9 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:43:40 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:43:40 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:43:40 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:43:40 user nova-compute[73079]:   <serial>a6eb5b43-fa2a-4256-af01-40c334ae380a</serial>
Aug 17 14:43:40 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:43:40 user nova-compute[73079]: </disk>
Aug 17 14:43:40 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:43:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Successfully detached device vdb from instance 42c5a511-402c-4712-a07e-1639512a7be9 from the persistent domain config.
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42c5a511-402c-4712-a07e-1639512a7be9 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:43:40 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:43:40 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:43:40 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:43:40 user nova-compute[73079]:   <serial>a6eb5b43-fa2a-4256-af01-40c334ae380a</serial>
Aug 17 14:43:40 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:43:40 user nova-compute[73079]: </disk>
Aug 17 14:43:40 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Updated VIF entry in instance network info cache for port c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Updating instance_info_cache with network_info: [{"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-27293993-5fae-4444-bccc-34d5a04a3aad req-06325339-553f-497c-8e8d-1b1180536426 service nova] Releasing lock "refresh_cache-89cd463e-6624-4963-8007-aa6094f7e890" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283420.6616726, 42c5a511-402c-4712-a07e-1639512a7be9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:43:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Successfully detached device vdb from instance 42c5a511-402c-4712-a07e-1639512a7be9 from the live domain config.
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfsOVyHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'a6eb5b43-fa2a-4256-af01-40c334ae380a'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:40 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64989583-8c88-419d-b373-3e03adc979d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685070f-10e3-40e8-8f1b-ca324b17d945]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:40 user nova-compute[73079]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:40 user nova-compute[73079]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a (non-flash)
Aug 17 14:43:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8289750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9ede1-7cce-48e6-a083-6b8eaf16b2dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e7ba5-b0a8-4448-9c90-4304483524cc]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc5cc02-a2a6-4fb0-b2b9-0d73fd7268b6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c48f9c4-0bab-422b-ad3f-f8263c77d4a6]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e144f4-31ab-4f51-beee-db01aeb9c94e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[124755b1-3372-4903-9a84-48b14aba85dc]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260]
Aug 17 14:43:40 user nova-compute[73079]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a, portal: 172.16.0.220,3260] successful.
Aug 17 14:43:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6eb5b43-fa2a-4256-af01-40c334ae380a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8ed51-a720-4f72-8591-73d87494af81]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] <== disconnect_volume: return (276ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-1cdaff4a-a049-4e3d-9640-8001bfe70d3f req-454989a6-0102-483b-b60b-745ad8013d39 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1cdaff4a-a049-4e3d-9640-8001bfe70d3f req-454989a6-0102-483b-b60b-745ad8013d39 service nova] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1cdaff4a-a049-4e3d-9640-8001bfe70d3f req-454989a6-0102-483b-b60b-745ad8013d39 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1cdaff4a-a049-4e3d-9640-8001bfe70d3f req-454989a6-0102-483b-b60b-745ad8013d39 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-1cdaff4a-a049-4e3d-9640-8001bfe70d3f req-454989a6-0102-483b-b60b-745ad8013d39 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] No waiting events found dispatching network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:42 user nova-compute[73079]: WARNING nova.compute.manager [req-1cdaff4a-a049-4e3d-9640-8001bfe70d3f req-454989a6-0102-483b-b60b-745ad8013d39 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received unexpected event network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 for instance with vm_state building and task_state spawning.
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283422.1246943, 89cd463e-6624-4963-8007-aa6094f7e890 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] VM Resumed (Lifecycle Event)
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Instance spawned successfully.
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283422.1282296, 89cd463e-6624-4963-8007-aa6094f7e890 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] VM Started (Lifecycle Event)
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lazy-loading 'flavor' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ffb76fcf-efe7-471a-ace1-489dcff7b458 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.296s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:42 user nova-compute[73079]: INFO nova.compute.manager [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Took 7.79 seconds to build instance.
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9276cf9-d37a-48ab-b38b-cb72fc9e0860 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "89cd463e-6624-4963-8007-aa6094f7e890" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.923s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-changed-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Refreshing instance network info cache due to event network-changed-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] Acquiring lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] Acquired lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:43:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Refreshing network info cache for port 2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updated VIF entry in instance network info cache for port 2f2b56eb-a29f-4159-a45d-7cc7cd2eea80. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updating instance_info_cache with network_info: [{"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-753caaf3-fb63-42bf-83ed-e4d6b90e90f7 req-b705d0bc-b3c4-4270-b588-43c6245c6e46 service nova] Releasing lock "refresh_cache-cb8ad507-b5da-467c-8008-f43573b7e7c3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:43 user nova-compute[73079]: INFO nova.compute.manager [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Terminating instance
Aug 17 14:43:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'flavor' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.241s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Instance destroyed successfully.
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lazy-loading 'resources' on Instance uuid fc221fd3-a333-4a8e-8d14-d273c3f292e5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2071158390',display_name='tempest-VolumesAssistedSnapshotsTest-server-2071158390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2071158390',id=8,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvvDRQw/3qNlyb+J0WUTYidd//8MhFScFUZtZrfZB97MHznmQYGqmxzaMvRlreo0WJ4zcEiCgfyAuXlfjE09ig06yBZWn66SdZiDiRj3oyZtEMRp6U7jclywkkcLjOj8A==',key_name='tempest-keypair-653267722',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f5c123a46c142c19c923adcb827766a',ramdisk_id='',reservation_id='r-ws4oi6bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-193124930',owner_user_name='tempest-VolumesAssistedSnapshotsTest-193124930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b99a131a54f479aaf9015cfc084583a',uuid=fc221fd3-a333-4a8e-8d14-d273c3f292e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Converting VIF {"id": "85873d00-bda0-4344-a605-653ab82f45c1", "address": "fa:16:3e:b3:f8:77", "network": {"id": "dfb7a643-1a02-4b86-a188-74c786406e45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2000224003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f5c123a46c142c19c923adcb827766a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85873d00-bd", "ovs_interfaceid": "85873d00-bda0-4344-a605-653ab82f45c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_vif [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85873d00-bd, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:44 user nova-compute[73079]: INFO os_vif [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:f8:77,bridge_name='br-int',has_traffic_filtering=True,id=85873d00-bda0-4344-a605-653ab82f45c1,network=Network(dfb7a643-1a02-4b86-a188-74c786406e45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85873d00-bd')
Aug 17 14:43:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Deleting instance files /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5_del
Aug 17 14:43:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Deletion of /opt/stack/data/nova/instances/fc221fd3-a333-4a8e-8d14-d273c3f292e5_del complete
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: INFO nova.compute.manager [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attaching volume 78c6cbf0-19b5-490b-95ae-ece07f037d57 to /dev/vdb
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:44 user nova-compute[73079]: INFO nova.compute.manager [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Terminating instance
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:43:44 user nova-compute[73079]: INFO nova.compute.manager [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_brick.utils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1ef43-1401-4af8-91b1-42d03e77f9f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d00578-eae9-4224-8935-e89a2774e3a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9587c83-96be-4433-b2ea-0e0cd4b66153]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e89adb-d522-4a83-8da8-166b9d885406]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:44 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b762e0-0807-4ee2-8908-d35defad683a]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG os_brick.utils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updating existing volume attachment record: 343aac6d-89c4-4bdf-b441-2d65d8675254 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-vif-unplugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] No waiting events found dispatching network-vif-unplugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-vif-unplugged-85873d00-bda0-4344-a605-653ab82f45c1 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] Acquiring lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] No waiting events found dispatching network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:44 user nova-compute[73079]: WARNING nova.compute.manager [req-444912f9-6cc5-4fb2-9a60-80c841d670ec req-7e04475d-bdb2-4a41-8ea5-9dfcc4c412d7 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received unexpected event network-vif-plugged-85873d00-bda0-4344-a605-653ab82f45c1 for instance with vm_state active and task_state deleting.
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7d61613-5629-4c68-96a8-693785ac78a1 req-b7041e18-223f-454d-af77-5fc32d141d8d service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-vif-unplugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7d61613-5629-4c68-96a8-693785ac78a1 req-b7041e18-223f-454d-af77-5fc32d141d8d service nova] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7d61613-5629-4c68-96a8-693785ac78a1 req-b7041e18-223f-454d-af77-5fc32d141d8d service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7d61613-5629-4c68-96a8-693785ac78a1 req-b7041e18-223f-454d-af77-5fc32d141d8d service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7d61613-5629-4c68-96a8-693785ac78a1 req-b7041e18-223f-454d-af77-5fc32d141d8d service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] No waiting events found dispatching network-vif-unplugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7d61613-5629-4c68-96a8-693785ac78a1 req-b7041e18-223f-454d-af77-5fc32d141d8d service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-vif-unplugged-f043655d-a46b-409f-9e59-ddaae9b4297c for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:43:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Instance destroyed successfully.
Aug 17 14:43:45 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lazy-loading 'resources' on Instance uuid 5e196ca7-2142-4c24-b3fe-800e360cbe49 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1978746464',display_name='tempest-ServersNegativeTestJSON-server-1978746464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1978746464',id=11,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40c83cb8ee234c77bf65a94c176b47b5',ramdisk_id='',reservation_id='r-lubumqbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-146357167',owner_user_name='tempest-ServersNegativeTestJSON-146357167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:42:01Z,user_data=None,user_id='8ae8ba1f04474c00be03b2d8ea745f97',uuid=5e196ca7-2142-4c24-b3fe-800e360cbe49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converting VIF {"id": "f043655d-a46b-409f-9e59-ddaae9b4297c", "address": "fa:16:3e:85:26:d2", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043655d-a4", "ovs_interfaceid": "f043655d-a46b-409f-9e59-ddaae9b4297c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG os_vif [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf043655d-a4, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:45 user nova-compute[73079]: INFO os_vif [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:26:d2,bridge_name='br-int',has_traffic_filtering=True,id=f043655d-a46b-409f-9e59-ddaae9b4297c,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043655d-a4')
Aug 17 14:43:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Deleting instance files /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49_del
Aug 17 14:43:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Deletion of /opt/stack/data/nova/instances/5e196ca7-2142-4c24-b3fe-800e360cbe49_del complete
Aug 17 14:43:45 user nova-compute[73079]: INFO nova.compute.manager [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 14:43:45 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:43:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:46 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Took 1.67 seconds to deallocate network for instance.
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:43:46 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Took 0.99 seconds to deallocate network for instance.
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.275s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:46 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Deleted allocations for instance fc221fd3-a333-4a8e-8d14-d273c3f292e5
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9146e64f-885f-43c3-9f46-8c0c10c3e824 tempest-VolumesAssistedSnapshotsTest-193124930 tempest-VolumesAssistedSnapshotsTest-193124930-project-member] Lock "fc221fd3-a333-4a8e-8d14-d273c3f292e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.405s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-91ed2125-2bf3-4953-b783-febe91f3de23 req-988fb8bb-afab-46bc-b1d0-de68087096c4 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-91ed2125-2bf3-4953-b783-febe91f3de23 req-988fb8bb-afab-46bc-b1d0-de68087096c4 service nova] Acquiring lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-91ed2125-2bf3-4953-b783-febe91f3de23 req-988fb8bb-afab-46bc-b1d0-de68087096c4 service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-91ed2125-2bf3-4953-b783-febe91f3de23 req-988fb8bb-afab-46bc-b1d0-de68087096c4 service nova] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-91ed2125-2bf3-4953-b783-febe91f3de23 req-988fb8bb-afab-46bc-b1d0-de68087096c4 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] No waiting events found dispatching network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:43:46 user nova-compute[73079]: WARNING nova.compute.manager [req-91ed2125-2bf3-4953-b783-febe91f3de23 req-988fb8bb-afab-46bc-b1d0-de68087096c4 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received unexpected event network-vif-plugged-f043655d-a46b-409f-9e59-ddaae9b4297c for instance with vm_state deleted and task_state None.
Aug 17 14:43:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-55e54618-180f-48db-baad-a849f1242d22 req-21cacf77-eea8-493d-a588-6b88c8cc4905 service nova] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Received event network-vif-deleted-85873d00-bda0-4344-a605-653ab82f45c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-55e54618-180f-48db-baad-a849f1242d22 req-21cacf77-eea8-493d-a588-6b88c8cc4905 service nova] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Received event network-vif-deleted-f043655d-a46b-409f-9e59-ddaae9b4297c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:43:47 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:43:47 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:43:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:47 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Deleted allocations for instance 5e196ca7-2142-4c24-b3fe-800e360cbe49
Aug 17 14:43:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7436da30-06e7-43c0-8b6a-a39ca090a17d tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "5e196ca7-2142-4c24-b3fe-800e360cbe49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.068s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:51 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'flavor' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:52 user nova-compute[73079]: INFO nova.compute.manager [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Attaching volume e93a3e41-c79e-49fe-995e-8f11b66501d8 to /dev/vdb
Aug 17 14:43:52 user nova-compute[73079]: DEBUG os_brick.utils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[added850-e5b7-4924-82e2-41ab8f7cc5f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4e202-3355-4618-842a-d487d247c22c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b0c14-e8fc-4114-b0d1-7f771e6cf11d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b6abe-ea36-4df3-9540-4394c983becf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:52 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:43:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef4058-829b-459d-a097-37de9d47ab34]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG os_brick.utils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:52 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating existing volume attachment record: 73b6c133-c02e-48f6-8010-820b077e3cca {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:43:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'flavor' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:43:56 user nova-compute[73079]: INFO nova.compute.manager [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Attaching volume 2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 to /dev/vdb
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.utils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c9c56-3f38-4fcf-a65c-879f244069fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a9aa3-8933-422e-9adf-3a7327c25288]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc29feb-1301-4e29-af1c-db940ec00e1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f275aea-a14b-4ea2-9aec-cd8b7c48630b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:43:56 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f603fec-8eee-40f6-b536-979ff25a8ed6]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.utils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating existing volume attachment record: d25a50a9-c0f9-4833-9812-41920c25d118 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIBRWpoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:43:56 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:56 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:43:56 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00837d9-12ad-465c-8e69-f9968cde7f36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:43:56 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b81136-5155-4f84-9633-399045144ec6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57] added
Aug 17 14:43:56 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9c86aa-1202-401e-ade8-817285d19fa6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa80b2-8f26-4d0f-b60d-f66bb66dfc3e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIBRWpoN {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIBRWpoN" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c21716c-7c9a-4a77-a3a9-4fd4717b5888]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OIBRWpoN'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae734e6-7669-48b3-8d9d-0c98c9c501fb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e5a1e-c53b-4895-ac18-a5da2cb4cd08]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:56 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:56 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa0b15-313f-4ac8-be24-f3f1c4862866]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260]
Aug 17 14:43:57 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260] successful.
Aug 17 14:43:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde030b-d0fe-4fa1-b0ad-80adddfa8780]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa766c6-2a29-4acd-b356-a4d7e712cc7d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:43:57 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:43:57 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:43:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce1cb7-5e34-4e59-b577-780feea03c96]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIBRWpoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:43:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26662376635306238', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662376635306238', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'flavor' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:43:58 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:43:58 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:43:58 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:43:58 user nova-compute[73079]:   <serial>78c6cbf0-19b5-490b-95ae-ece07f037d57</serial>
Aug 17 14:43:58 user nova-compute[73079]: </disk>
Aug 17 14:43:58 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No VIF found with MAC fa:16:3e:19:b6:62, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:43:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b991d4d2-0dac-4bcb-8f6f-cf7c21d6963b tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.403s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:43:59 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283424.2125473, fc221fd3-a333-4a8e-8d14-d273c3f292e5 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:43:59 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] VM Stopped (Lifecycle Event)
Aug 17 14:43:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99f02f34-5049-4217-9f0d-c7fb2e848f0c None None] [instance: fc221fd3-a333-4a8e-8d14-d273c3f292e5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283425.1092465, 5e196ca7-2142-4c24-b3fe-800e360cbe49 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:00 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] VM Stopped (Lifecycle Event)
Aug 17 14:44:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-371a1b7b-a568-4db7-b72f-24a88178b5da None None] [instance: 5e196ca7-2142-4c24-b3fe-800e360cbe49] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:44:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:44:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:44:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'flavor' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:03 user nova-compute[73079]: INFO nova.compute.manager [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attaching volume c806a66a-d58f-4f63-a045-abdb3df3eb8c to /dev/vdc
Aug 17 14:44:03 user nova-compute[73079]: DEBUG os_brick.utils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[112c508c-8329-4325-9abe-8f49de2232c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c9905-a312-4943-a37f-5602ffe844b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[86785664-3275-46d2-b88d-088feed65a97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4c9b2-0be8-4f3e-aca4-a56f750870e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:44:03 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[651df717-33a7-4714-9e0e-d4cc564e9cab]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG os_brick.utils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updating existing volume attachment record: d221c211-d430-41b3-8203-67efb9549b09 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDBjbmSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:04 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e84fd3-1f85-466d-b6f9-a53b29ffe9e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:44:04 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7ae66-3512-4c15-a8b6-687bf44867c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8] added
Aug 17 14:44:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[62301f6d-a07a-49fd-9eb2-55828ec3927d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a1ad54-4d1d-4c51-a7fe-7a0a5ac7b14c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDBjbmSK {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDBjbmSK" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca19880-5523-4233-aabb-400859687d5e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PDBjbmSK'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5a1bc0-a68e-4000-a41d-0dc2df3f0ce0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac97c2d-2f3a-479d-bc6d-26bd7582a22b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ef1c4-b63a-4dd0-92b5-b529f08b157c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260]
Aug 17 14:44:04 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6caf18-887e-4fc5-a3d6-3f2577b3a41b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c481ae-c361-4c6f-8d25-35fc365925e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fbeb8e-ecb9-488a-b2dd-eeee9c64173d]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDBjbmSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26262386435306166', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262386435306166', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'flavor' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:44:05 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:05 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:44:05 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:44:05 user nova-compute[73079]:   <serial>e93a3e41-c79e-49fe-995e-8f11b66501d8</serial>
Aug 17 14:44:05 user nova-compute[73079]: </disk>
Aug 17 14:44:05 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:06 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:06 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7708MB free_disk=25.64904022216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No VIF found with MAC fa:16:3e:c5:62:0d, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a279bc96-247f-43e4-9d99-3dc690da4d0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 42c5a511-402c-4712-a07e-1639512a7be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cb8ad507-b5da-467c-8008-f43573b7e7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 89cd463e-6624-4963-8007-aa6094f7e890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ccf911c2-011e-41e1-a228-f6eba15d8a5e tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.629s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:44:06 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:44:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:44:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:44:08 user nova-compute[73079]: INFO nova.compute.manager [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Rescuing
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:08 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:08 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:08 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80506ee-303b-4ac2-83e4-3733935408a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:44:08 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c650e-b76e-4dcf-94fa-0e459acb1de8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783] added
Aug 17 14:44:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b52c8a-7569-475e-80ae-677dcdc7ac1e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1604a9d9-43af-494f-b539-60b25a3ac55f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWXhsifn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWXhsifn" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d6658-bd9d-4e8e-9f92-1ba2c0175113]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YWXhsifn'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b1f56-00fc-4710-bbb4-2a9d77ac3938]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58c60d-f546-4973-bfef-2c1c2a432ea0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:08 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:08 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:08 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:08 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf19f55-85e7-4a5b-af6a-da28e2b0e76a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]
Aug 17 14:44:09 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5aeb86-d56d-4b0d-a043-65aed958e64e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe6f74-1ec1-4f22-b38e-85c6da81fc36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[931f6446-5c38-4032-916d-e34827734631]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd4d81a4-9b12-40ef-9640-bdb4f02e42a1 req-11b2b218-96bd-4979-a01b-03e03eefd016 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd4d81a4-9b12-40ef-9640-bdb4f02e42a1 req-11b2b218-96bd-4979-a01b-03e03eefd016 service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd4d81a4-9b12-40ef-9640-bdb4f02e42a1 req-11b2b218-96bd-4979-a01b-03e03eefd016 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd4d81a4-9b12-40ef-9640-bdb4f02e42a1 req-11b2b218-96bd-4979-a01b-03e03eefd016 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd4d81a4-9b12-40ef-9640-bdb4f02e42a1 req-11b2b218-96bd-4979-a01b-03e03eefd016 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:09 user nova-compute[73079]: WARNING nova.compute.manager [req-dd4d81a4-9b12-40ef-9640-bdb4f02e42a1 req-11b2b218-96bd-4979-a01b-03e03eefd016 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state rescuing.
Aug 17 14:44:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance destroyed successfully.
Aug 17 14:44:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Attempting a stable device rescue
Aug 17 14:44:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73079) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 14:44:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Creating image(s)
Aug 17 14:44:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.187s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== connect_volume: return (1576ms) {'type': 'block', 'scsi_wwn': '23366383634666538', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366383634666538', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'flavor' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "f8d6b94967dedc125156cdc8ba10336113c7db05" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "f8d6b94967dedc125156cdc8ba10336113c7db05" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:44:10 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:10 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:44:10 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:44:10 user nova-compute[73079]:   <serial>2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783</serial>
Aug 17 14:44:10 user nova-compute[73079]: </disk>
Aug 17 14:44:10 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No VIF found with MAC fa:16:3e:34:d7:35, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.virt.images [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] 5c7db043-11fb-472c-af50-fa05d4921566 was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.part /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-238f8b3b-b479-4fae-9126-eae32e20c0f6 req-49b83a9f-6be1-42e2-94a8-41d4c9263528 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-238f8b3b-b479-4fae-9126-eae32e20c0f6 req-49b83a9f-6be1-42e2-94a8-41d4c9263528 service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-238f8b3b-b479-4fae-9126-eae32e20c0f6 req-49b83a9f-6be1-42e2-94a8-41d4c9263528 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-238f8b3b-b479-4fae-9126-eae32e20c0f6 req-49b83a9f-6be1-42e2-94a8-41d4c9263528 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-238f8b3b-b479-4fae-9126-eae32e20c0f6 req-49b83a9f-6be1-42e2-94a8-41d4c9263528 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:11 user nova-compute[73079]: WARNING nova.compute.manager [req-238f8b3b-b479-4fae-9126-eae32e20c0f6 req-49b83a9f-6be1-42e2-94a8-41d4c9263528 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state rescuing.
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b75573a1-0d47-4107-a57d-8a4ba8d573cd tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.329s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.part /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.converted" returned: 0 in 0.338s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "f8d6b94967dedc125156cdc8ba10336113c7db05" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.663s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "f8d6b94967dedc125156cdc8ba10336113c7db05" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "f8d6b94967dedc125156cdc8ba10336113c7db05" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05 --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05,backing_fmt=raw /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05,backing_fmt=raw /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue" returned: 0 in 0.050s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "f8d6b94967dedc125156cdc8ba10336113c7db05" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'migration_context' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Start _get_guest_xml network_info=[{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "vif_mac": "fa:16:3e:c5:62:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5c7db043-11fb-472c-af50-fa05d4921566', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '73b6c133-c02e-48f6-8010-820b077e3cca', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDBjbmSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '02f2d969-22f4-4785-a5e2-c805d45256b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e93a3e41-c79e-49fe-995e-8f11b66501d8', 'serial': 'e93a3e41-c79e-49fe-995e-8f11b66501d8'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'resources' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'numa_topology' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDBjbmSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:12 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b513da3-13c6-4110-95f4-2d5d68df8a9b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PDBjbmSK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 14:44:12 user nova-compute[73079]: node.name = iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8
Aug 17 14:44:12 user nova-compute[73079]: node.tpgt = -1
Aug 17 14:44:12 user nova-compute[73079]: node.startup = automatic
Aug 17 14:44:12 user nova-compute[73079]: node.leading_login = No
Aug 17 14:44:12 user nova-compute[73079]: iface.iscsi_ifacename = default
Aug 17 14:44:12 user nova-compute[73079]: iface.net_ifacename = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.ipaddress = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.prefix_len = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.hwaddress = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.transport_name = tcp
Aug 17 14:44:12 user nova-compute[73079]: iface.initiatorname = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.vlan_id = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.vlan_priority = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.vlan_state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.iface_num = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.mtu = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.port = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.bootproto = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.subnet_mask = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.gateway = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_alt_client_id = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_dns = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_learn_iqn = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_vendor_id_state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_vendor_id = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.dhcp_slp_da = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.fragmentation = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.gratuitous_arp = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.incoming_forwarding = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.tos_state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.tos = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.ttl = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.delayed_ack = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.tcp_nagle = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.tcp_wsf_state = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.tcp_wsf = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.tcp_timer_scale = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.tcp_timestamp = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.redirect = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.def_task_mgmt_timeout = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.header_digest = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.data_digest = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.immediate_data = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.initial_r2t = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.data_seq_inorder = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.data_pdu_inorder = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.erl = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.max_receive_data_len = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.first_burst_len = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.max_outstanding_r2t = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.max_burst_len = 0
Aug 17 14:44:12 user nova-compute[73079]: iface.chap_auth = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.bidi_chap = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.strict_login_compliance = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.discovery_auth = <empty>
Aug 17 14:44:12 user nova-compute[73079]: iface.discovery_logout = <empty>
Aug 17 14:44:12 user nova-compute[73079]: node.discovery_address = <empty>
Aug 17 14:44:12 user nova-compute[73079]: node.discovery_port = 0
Aug 17 14:44:12 user nova-compute[73079]: node.discovery_type = static
Aug 17 14:44:12 user nova-compute[73079]: node.session.initial_cmdsn = 0
Aug 17 14:44:12 user nova-compute[73079]: node.session.initial_login_retry_max = 8
Aug 17 14:44:12 user nova-compute[73079]: node.session.xmit_thread_priority = -20
Aug 17 14:44:12 user nova-compute[73079]: node.session.cmds_max = 128
Aug 17 14:44:12 user nova-compute[73079]: node.session.queue_depth = 32
Aug 17 14:44:12 user nova-compute[73079]: node.session.nr_sessions = 1
Aug 17 14:44:12 user nova-compute[73079]: node.session.auth.authmethod = CHAP
Aug 17 14:44:12 user nova-compute[73079]: node.session.auth.username = PDBjbmSK
Aug 17 14:44:12 user nova-compute[73079]: node.session.auth.password = ***
Aug 17 14:44:12 user nova-compute[73079]: node.session.auth.username_in = <empty>
Aug 17 14:44:12 user nova-compute[73079]: node.session.auth.password_in = <empty>
Aug 17 14:44:12 user nova-compute[73079]: node.session.auth.chap_algs = MD5
Aug 17 14:44:12 user nova-compute[73079]: node.session.timeo.replacement_timeout = 120
Aug 17 14:44:12 user nova-compute[73079]: node.session.err_timeo.abort_timeout = 15
Aug 17 14:44:12 user nova-compute[73079]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 14:44:12 user nova-compute[73079]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 14:44:12 user nova-compute[73079]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.FastAbort = Yes
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.InitialR2T = No
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.ImmediateData = Yes
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.MaxConnections = 1
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 14:44:12 user nova-compute[73079]: node.session.iscsi.ERL = 0
Aug 17 14:44:12 user nova-compute[73079]: node.session.scan = manual
Aug 17 14:44:12 user nova-compute[73079]: node.session.reopen_max = 0
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].address = 172.16.0.220
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].port = 3260
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].startup = manual
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].tcp.window_size = 524288
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].tcp.type_of_service = 0
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].timeo.logout_timeout = 15
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].timeo.login_timeout = 15
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].timeo.auth_timeout = 45
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].iscsi.DataDigest = None
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].iscsi.IFMarker = No
Aug 17 14:44:12 user nova-compute[73079]: node.conn[0].iscsi.OFMarker = No
Aug 17 14:44:12 user nova-compute[73079]: # END RECORD
Aug 17 14:44:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f35206b-bad9-466e-9019-72307f05a14b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d4b624-0125-4ed6-8434-18cfc4913eb9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDBjbmSK {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDBjbmSK" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf8dd5e-4d27-4132-83b6-7ff7254954e4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PDBjbmSK'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fddc1b7-dfd0-447d-93e2-6a8ff2076eed]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbccbcd0-0480-488e-814f-98a6a206ce95]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] HCTL ('35', '0', '0', 0) found on session 11 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b31127-360a-4834-9c07-5b00a4ce5621]: (4, ('0 0 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Searching for a device in session 11 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDBjbmSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '26262386435306166', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262386435306166', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1518138782',display_name='tempest-ServerStableDeviceRescueTest-server-1518138782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1518138782',id=4,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsAjCIc/WwAiAI8Pzwwt/hC03akqhW8QrVflG2svRsETTn8bw3n5V1LOPK7odRcM4K6pl/+pi/eRmipG6h+fDbLKiqHSrOsDumuGA6bSQbmWMlWwULwwhp9wtA9pedt2w==',key_name='tempest-keypair-41245435',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ba4161b12a4a238ecd22749dff64c4',ramdisk_id='',reservation_id='r-c84flbdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1672943422',owner_user_name='tempest-ServerStableDeviceRescueTest-1672943422-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285ec6eef26e43ef82c9fb559594e1be',uuid=02f2d969-22f4-4785-a5e2-c805d45256b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "vif_mac": "fa:16:3e:c5:62:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converting VIF {"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "vif_mac": "fa:16:3e:c5:62:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'pci_devices' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:44:12 user nova-compute[73079]:   <uuid>02f2d969-22f4-4785-a5e2-c805d45256b3</uuid>
Aug 17 14:44:12 user nova-compute[73079]:   <name>instance-00000004</name>
Aug 17 14:44:12 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:44:12 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:44:12 user nova-compute[73079]:   <metadata>
Aug 17 14:44:12 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:44:12 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:44:12 user nova-compute[73079]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1518138782</nova:name>
Aug 17 14:44:12 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:44:12</nova:creationTime>
Aug 17 14:44:12 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:44:12 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:44:12 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:44:12 user nova-compute[73079]:       <nova:owner>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:user uuid="285ec6eef26e43ef82c9fb559594e1be">tempest-ServerStableDeviceRescueTest-1672943422-project-member</nova:user>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:project uuid="c7ba4161b12a4a238ecd22749dff64c4">tempest-ServerStableDeviceRescueTest-1672943422</nova:project>
Aug 17 14:44:12 user nova-compute[73079]:       </nova:owner>
Aug 17 14:44:12 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:44:12 user nova-compute[73079]:       <nova:ports>
Aug 17 14:44:12 user nova-compute[73079]:         <nova:port uuid="c19575ab-dfc7-4e70-ac23-4a37a0044152">
Aug 17 14:44:12 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 14:44:12 user nova-compute[73079]:         </nova:port>
Aug 17 14:44:12 user nova-compute[73079]:       </nova:ports>
Aug 17 14:44:12 user nova-compute[73079]:     </nova:instance>
Aug 17 14:44:12 user nova-compute[73079]:   </metadata>
Aug 17 14:44:12 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:44:12 user nova-compute[73079]:     <system>
Aug 17 14:44:12 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:44:12 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:44:12 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:44:12 user nova-compute[73079]:       <entry name="serial">02f2d969-22f4-4785-a5e2-c805d45256b3</entry>
Aug 17 14:44:12 user nova-compute[73079]:       <entry name="uuid">02f2d969-22f4-4785-a5e2-c805d45256b3</entry>
Aug 17 14:44:12 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:44:12 user nova-compute[73079]:     </system>
Aug 17 14:44:12 user nova-compute[73079]:   </sysinfo>
Aug 17 14:44:12 user nova-compute[73079]:   <os>
Aug 17 14:44:12 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:44:12 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:44:12 user nova-compute[73079]:   </os>
Aug 17 14:44:12 user nova-compute[73079]:   <features>
Aug 17 14:44:12 user nova-compute[73079]:     <acpi/>
Aug 17 14:44:12 user nova-compute[73079]:     <apic/>
Aug 17 14:44:12 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:44:12 user nova-compute[73079]:   </features>
Aug 17 14:44:12 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:44:12 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:44:12 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:44:12 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:44:12 user nova-compute[73079]:   </clock>
Aug 17 14:44:12 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:44:12 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:44:12 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:44:12 user nova-compute[73079]:   </cpu>
Aug 17 14:44:12 user nova-compute[73079]:   <devices>
Aug 17 14:44:12 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:44:12 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:44:12 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk"/>
Aug 17 14:44:12 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:44:12 user nova-compute[73079]:     </disk>
Aug 17 14:44:12 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:44:12 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:12 user nova-compute[73079]:       <source dev="/dev/sdd"/>
Aug 17 14:44:12 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:44:12 user nova-compute[73079]:       <serial>e93a3e41-c79e-49fe-995e-8f11b66501d8</serial>
Aug 17 14:44:12 user nova-compute[73079]:     </disk>
Aug 17 14:44:12 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:44:12 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:44:12 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue"/>
Aug 17 14:44:12 user nova-compute[73079]:       <target dev="vdc" bus="virtio"/>
Aug 17 14:44:12 user nova-compute[73079]:       <boot order="1"/>
Aug 17 14:44:12 user nova-compute[73079]:     </disk>
Aug 17 14:44:12 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:44:12 user nova-compute[73079]:       <mac address="fa:16:3e:c5:62:0d"/>
Aug 17 14:44:12 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:44:12 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:44:12 user nova-compute[73079]:       <target dev="tapc19575ab-df"/>
Aug 17 14:44:12 user nova-compute[73079]:     </interface>
Aug 17 14:44:12 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:44:12 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/console.log" append="off"/>
Aug 17 14:44:12 user nova-compute[73079]:     </serial>
Aug 17 14:44:12 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:44:12 user nova-compute[73079]:     <video>
Aug 17 14:44:12 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:44:12 user nova-compute[73079]:     </video>
Aug 17 14:44:12 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:44:12 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:44:12 user nova-compute[73079]:     </rng>
Aug 17 14:44:12 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:44:12 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:44:12 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:44:12 user nova-compute[73079]:     </memballoon>
Aug 17 14:44:12 user nova-compute[73079]:   </devices>
Aug 17 14:44:12 user nova-compute[73079]: </domain>
Aug 17 14:44:12 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:44:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance destroyed successfully.
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] No VIF found with MAC fa:16:3e:c5:62:0d, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Stashing vm_state: active {{(pid=73079) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-37d9c04b-ea37-4525-b4da-290f045edf34 req-a9806f91-f4db-4636-a69e-036ca55ec3fc service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-37d9c04b-ea37-4525-b4da-290f045edf34 req-a9806f91-f4db-4636-a69e-036ca55ec3fc service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-37d9c04b-ea37-4525-b4da-290f045edf34 req-a9806f91-f4db-4636-a69e-036ca55ec3fc service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-37d9c04b-ea37-4525-b4da-290f045edf34 req-a9806f91-f4db-4636-a69e-036ca55ec3fc service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-37d9c04b-ea37-4525-b4da-290f045edf34 req-a9806f91-f4db-4636-a69e-036ca55ec3fc service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:14 user nova-compute[73079]: WARNING nova.compute.manager [req-37d9c04b-ea37-4525-b4da-290f045edf34 req-a9806f91-f4db-4636-a69e-036ca55ec3fc service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state rescuing.
Aug 17 14:44:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'pci_requests' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:44:14 user nova-compute[73079]: INFO nova.compute.claims [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Claim successful on node user
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'resources' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:14 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating resource usage from migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:44:14 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.534s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:15 user nova-compute[73079]: INFO nova.compute.manager [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Migrating
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:44:15 user nova-compute[73079]: INFO nova.compute.rpcapi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Starting migrate_disk_and_power_off {{(pid=73079) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-da3687a7-9589-47b1-ba9f-8608c665298c req-32c76ad7-d67b-49a1-ab51-9e9bff5ee4b9 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-da3687a7-9589-47b1-ba9f-8608c665298c req-32c76ad7-d67b-49a1-ab51-9e9bff5ee4b9 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-da3687a7-9589-47b1-ba9f-8608c665298c req-32c76ad7-d67b-49a1-ab51-9e9bff5ee4b9 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-da3687a7-9589-47b1-ba9f-8608c665298c req-32c76ad7-d67b-49a1-ab51-9e9bff5ee4b9 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-da3687a7-9589-47b1-ba9f-8608c665298c req-32c76ad7-d67b-49a1-ab51-9e9bff5ee4b9 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:16 user nova-compute[73079]: WARNING nova.compute.manager [req-da3687a7-9589-47b1-ba9f-8608c665298c req-32c76ad7-d67b-49a1-ab51-9e9bff5ee4b9 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state resize_migrating.
Aug 17 14:44:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-a27f681a-274c-49ac-a2ce-12953a0560ff req-948a59ee-3968-4fb8-b42a-0dc62912df7a service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a27f681a-274c-49ac-a2ce-12953a0560ff req-948a59ee-3968-4fb8-b42a-0dc62912df7a service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a27f681a-274c-49ac-a2ce-12953a0560ff req-948a59ee-3968-4fb8-b42a-0dc62912df7a service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a27f681a-274c-49ac-a2ce-12953a0560ff req-948a59ee-3968-4fb8-b42a-0dc62912df7a service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-a27f681a-274c-49ac-a2ce-12953a0560ff req-948a59ee-3968-4fb8-b42a-0dc62912df7a service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:16 user nova-compute[73079]: WARNING nova.compute.manager [req-a27f681a-274c-49ac-a2ce-12953a0560ff req-948a59ee-3968-4fb8-b42a-0dc62912df7a service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state rescuing.
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 02f2d969-22f4-4785-a5e2-c805d45256b3 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283456.42686, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Resumed (Lifecycle Event)
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6e72a28d-2ffb-4297-8d4f-d526730e4ead tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283456.4308574, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Started (Lifecycle Event)
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance destroyed successfully.
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5955a467-f3, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:16 user nova-compute[73079]: INFO os_vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3')
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ddbac2-ad56-4217-b51d-99a9fe8607e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7e071c-4b3d-4028-94e3-8bb077ecab7e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f513e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDCeqwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe78a9d-6f01-4628-90f1-85b0bb2146ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[07109c9d-02e1-4b25-8e3e-2fb1a5654f1b]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb7d99a-1d1b-4071-8220-7e14429392af]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c376aeb4-9988-4866-b829-20cd00de12d9]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d9669b-4eb1-49e8-9e75-dd58faad0722]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[638006bf-6ccd-4171-9558-bee8465db19d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]
Aug 17 14:44:16 user nova-compute[73079]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb27cce-5c6e-4cd5-890a-c28e24aaef29]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== disconnect_volume: return (300ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.218s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:16 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae81e63-162d-4608-a645-14eaf81ef08f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:44:16 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8911d53-8c08-4bae-be24-dc752da5c2c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c] added
Aug 17 14:44:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69c5f7-73b4-4bf2-9dc5-178a2fe6fa94]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c9a468-6bec-4df4-b45a-71793cb1d394]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSDCeqwo {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSDCeqwo" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7b7678-5e0d-45b7-8168-32aa5fa358b6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSDCeqwo'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa650c0-09db-4fe7-8625-437024d06fa9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc76f6c-6a4d-4233-ac96-abbc45ee65c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144c4b8-3c48-4019-bfcd-a4632f5b880a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260]
Aug 17 14:44:17 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b9972-6d3e-41a8-9deb-42ddb5c15111]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5e61c3-ca95-4920-a14a-36ce66030064]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c (non-flash)
Aug 17 14:44:17 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff26b99-7692-41e6-b730-936a918a4b28]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDCeqwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f_resize/disk /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "cp -r /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f_resize/disk /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk" returned: 0 in 0.343s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f_resize/disk.info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk.info {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "cp -r /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f_resize/disk.info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk.info" returned: 0 in 0.034s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-8f40aab2-ec15-40c4-846e-ad1b627a69ae req-16e42711-f449-4537-aae0-fef0664e4841 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8f40aab2-ec15-40c4-846e-ad1b627a69ae req-16e42711-f449-4537-aae0-fef0664e4841 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8f40aab2-ec15-40c4-846e-ad1b627a69ae req-16e42711-f449-4537-aae0-fef0664e4841 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8f40aab2-ec15-40c4-846e-ad1b627a69ae req-16e42711-f449-4537-aae0-fef0664e4841 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-8f40aab2-ec15-40c4-846e-ad1b627a69ae req-16e42711-f449-4537-aae0-fef0664e4841 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:18 user nova-compute[73079]: WARNING nova.compute.manager [req-8f40aab2-ec15-40c4-846e-ad1b627a69ae req-16e42711-f449-4537-aae0-fef0664e4841 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state resize_migrating.
Aug 17 14:44:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] <== connect_volume: return (1685ms) {'type': 'block', 'scsi_wwn': '26339343531343666', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339343531343666', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'flavor' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:44:18 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:18 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:44:18 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:44:18 user nova-compute[73079]:   <serial>c806a66a-d58f-4f63-a045-abdb3df3eb8c</serial>
Aug 17 14:44:18 user nova-compute[73079]: </disk>
Aug 17 14:44:18 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] No VIF found with MAC fa:16:3e:19:b6:62, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Port 5955a467-f321-452d-812d-4796e5b7d6df binding to destination host user is already ACTIVE {{(pid=73079) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a8ca0bfa-a7be-4fd0-985c-05313037e43c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.739s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:44:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:20 user nova-compute[73079]: INFO nova.compute.manager [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Detaching volume c806a66a-d58f-4f63-a045-abdb3df3eb8c
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:44:20 user nova-compute[73079]: INFO nova.virt.block_device [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attempting to driver detach volume c806a66a-d58f-4f63-a045-abdb3df3eb8c from mountpoint /dev/vdc
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Attempting to detach device vdc from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:44:20 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:20 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:44:20 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:44:20 user nova-compute[73079]:   <serial>c806a66a-d58f-4f63-a045-abdb3df3eb8c</serial>
Aug 17 14:44:20 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 14:44:20 user nova-compute[73079]: </disk>
Aug 17 14:44:20 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:44:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Successfully detached device vdc from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the persistent domain config.
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:44:20 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:20 user nova-compute[73079]:   <source dev="/dev/sde"/>
Aug 17 14:44:20 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:44:20 user nova-compute[73079]:   <serial>c806a66a-d58f-4f63-a045-abdb3df3eb8c</serial>
Aug 17 14:44:20 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 14:44:20 user nova-compute[73079]: </disk>
Aug 17 14:44:20 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.utils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cb9d2a-fdef-4120-9f16-e57a667c4af5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d19ec3f-8334-4d40-a722-c1f9afd411f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f97bf-ac17-46b4-8cbc-f633672725d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d44fc6-22b6-4ffd-b608-8e9e0dd61c11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:44:20 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6b0b9b-fc55-4527-83c0-a5d62637180a]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.utils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283460.8986616, cb8ad507-b5da-467c-8008-f43573b7e7c3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:44:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Successfully detached device vdc from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the live domain config.
Aug 17 14:44:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDCeqwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f65c2-21d0-45be-94ea-9b50ebe62e43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc6bc4-d5ae-4a66-85c2-65447540a9b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:20 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:20 user nova-compute[73079]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c (non-flash)
Aug 17 14:44:20 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:20 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:20 user nova-compute[73079]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c (non-flash)
Aug 17 14:44:20 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e80e0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2b4b1e-c0ce-427d-a668-5b4b804c2af9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[348c54ca-3feb-4965-980e-9fa28aaa72b2]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[319980e6-797a-4d42-8e71-75c6b574b989]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c4c4a-3c78-4e9b-a9a3-7c5a0bc57a42]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1813187e-22b6-4ea5-b035-45e3da5628cf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780f235-6660-44a2-964e-420b331fb646]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260]
Aug 17 14:44:21 user nova-compute[73079]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c806a66a-d58f-4f63-a045-abdb3df3eb8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[41493410-8d51-4c8c-8a58-20f6cc36a786]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] <== disconnect_volume: return (310ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:44:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'flavor' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8c05817b-493e-4386-8be0-5c27f75955fc tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.920s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:24 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.network.neutron [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'info_cache' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.network.neutron [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:44:25 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance destroyed successfully.
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'resources' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:42:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88abdc44-49, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:44:25 user nova-compute[73079]: INFO os_vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49')
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:25 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1abaf0-e1af-4f36-bb72-d008a096fab3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f7a7e5-95e9-4d08-8b23-c2b22a6ab7f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:25 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:25 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:25 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:25 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:25 user nova-compute[73079]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:25 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e81d0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[25000a4e-e5b4-442f-9f64-2c483538ac0f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c3152a-c054-4e6b-b974-618a32811122]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[74962d6e-b0d9-425a-aa27-8ca7cef1bf40]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[193f8f23-e1cb-47f2-8e44-e388757847a4]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9945f1-9333-4b1b-acfc-882e6cb4ba96]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3409ee-9a13-4e9e-93c6-75da0ebceab4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]
Aug 17 14:44:25 user nova-compute[73079]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:25 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72d18a-f4cc-4c80-8e73-c2e4563476c8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== disconnect_volume: return (291ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start _get_guest_xml network_info=[{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'ca78de04-3140-4b8d-ba96-5c75d82fd70a', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a', 'attached_at': '', 'detached_at': '', 'volume_id': '4a126b6f-9390-435a-89a1-fa19e9b3e107', 'serial': '4a126b6f-9390-435a-89a1-fa19e9b3e107'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'numa_topology' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'vcpu_model' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:44:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:25 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:26 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:26 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e5b25-c81a-47f2-9618-61d8bc995dce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:44:26 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d10a89-d7bb-4ba4-8d3b-5f9519f2577d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107] added
Aug 17 14:44:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a889bd8-36c7-4cf9-ae8e-4d095fca7b7f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff46db-b1ba-406c-ac8c-43f7c933e629]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNrnIuoe {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wNrnIuoe" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6c667-d91c-47a2-bc6a-24cb005f9c51]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wNrnIuoe'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a2e162-4878-4434-8403-f46073381418]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5fdc44-805a-4eef-875c-8d1583269029]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[68305116-8cb4-4fcb-a3fb-0bc256a9d4fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]
Aug 17 14:44:26 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e7e86-a251-497d-b95b-12d1da97b84d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf07d2a-54f0-461e-9fcb-5ddfaba78d90]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e68e0d-3132-497a-a8f4-b71b453fa4e2]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:44:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23230656466386533', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230656466386533', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:42:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'pci_devices' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:44:27 user nova-compute[73079]:   <uuid>259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</uuid>
Aug 17 14:44:27 user nova-compute[73079]:   <name>instance-00000005</name>
Aug 17 14:44:27 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:44:27 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:44:27 user nova-compute[73079]:   <metadata>
Aug 17 14:44:27 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:44:27 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:44:27 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeTestJSON-server-433840162</nova:name>
Aug 17 14:44:27 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:44:25</nova:creationTime>
Aug 17 14:44:27 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:44:27 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:44:27 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:44:27 user nova-compute[73079]:       <nova:owner>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:user uuid="e233ac54eb804ff0b6fdbf986a70dfe8">tempest-AttachVolumeTestJSON-831896009-project-member</nova:user>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:project uuid="3052ad0ca90d483284dd52edd3a79fbe">tempest-AttachVolumeTestJSON-831896009</nova:project>
Aug 17 14:44:27 user nova-compute[73079]:       </nova:owner>
Aug 17 14:44:27 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:44:27 user nova-compute[73079]:       <nova:ports>
Aug 17 14:44:27 user nova-compute[73079]:         <nova:port uuid="88abdc44-4987-4e42-aac5-80b85b07fa9e">
Aug 17 14:44:27 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 14:44:27 user nova-compute[73079]:         </nova:port>
Aug 17 14:44:27 user nova-compute[73079]:       </nova:ports>
Aug 17 14:44:27 user nova-compute[73079]:     </nova:instance>
Aug 17 14:44:27 user nova-compute[73079]:   </metadata>
Aug 17 14:44:27 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:44:27 user nova-compute[73079]:     <system>
Aug 17 14:44:27 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:44:27 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:44:27 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:44:27 user nova-compute[73079]:       <entry name="serial">259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</entry>
Aug 17 14:44:27 user nova-compute[73079]:       <entry name="uuid">259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</entry>
Aug 17 14:44:27 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:44:27 user nova-compute[73079]:     </system>
Aug 17 14:44:27 user nova-compute[73079]:   </sysinfo>
Aug 17 14:44:27 user nova-compute[73079]:   <os>
Aug 17 14:44:27 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:44:27 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:44:27 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:44:27 user nova-compute[73079]:   </os>
Aug 17 14:44:27 user nova-compute[73079]:   <features>
Aug 17 14:44:27 user nova-compute[73079]:     <acpi/>
Aug 17 14:44:27 user nova-compute[73079]:     <apic/>
Aug 17 14:44:27 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:44:27 user nova-compute[73079]:   </features>
Aug 17 14:44:27 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:44:27 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:44:27 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:44:27 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:44:27 user nova-compute[73079]:   </clock>
Aug 17 14:44:27 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:44:27 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:44:27 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:44:27 user nova-compute[73079]:   </cpu>
Aug 17 14:44:27 user nova-compute[73079]:   <devices>
Aug 17 14:44:27 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:44:27 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:44:27 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk"/>
Aug 17 14:44:27 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:44:27 user nova-compute[73079]:     </disk>
Aug 17 14:44:27 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:44:27 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:27 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 14:44:27 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:44:27 user nova-compute[73079]:       <serial>4a126b6f-9390-435a-89a1-fa19e9b3e107</serial>
Aug 17 14:44:27 user nova-compute[73079]:     </disk>
Aug 17 14:44:27 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:44:27 user nova-compute[73079]:       <mac address="fa:16:3e:44:20:b7"/>
Aug 17 14:44:27 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:44:27 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:44:27 user nova-compute[73079]:       <target dev="tap88abdc44-49"/>
Aug 17 14:44:27 user nova-compute[73079]:     </interface>
Aug 17 14:44:27 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:44:27 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/console.log" append="off"/>
Aug 17 14:44:27 user nova-compute[73079]:     </serial>
Aug 17 14:44:27 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:44:27 user nova-compute[73079]:     <video>
Aug 17 14:44:27 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:44:27 user nova-compute[73079]:     </video>
Aug 17 14:44:27 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:44:27 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:44:27 user nova-compute[73079]:     </rng>
Aug 17 14:44:27 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:44:27 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:44:27 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:44:27 user nova-compute[73079]:     </memballoon>
Aug 17 14:44:27 user nova-compute[73079]:   </devices>
Aug 17 14:44:27 user nova-compute[73079]: </domain>
Aug 17 14:44:27 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'trusted_certs' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.208s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Cannot resize image /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'migration_context' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:42:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG os_vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88abdc44-49, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88abdc44-49, col_values=(('external_ids', {'iface-id': '88abdc44-4987-4e42-aac5-80b85b07fa9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:20:b7', 'vm-uuid': '259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:44:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:28 user nova-compute[73079]: INFO os_vif [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49')
Aug 17 14:44:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-8df72d82-b208-4f7c-8b18-521ca1f74e24 req-e7d73ef0-206f-4542-9d78-346829f862b6 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8df72d82-b208-4f7c-8b18-521ca1f74e24 req-e7d73ef0-206f-4542-9d78-346829f862b6 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8df72d82-b208-4f7c-8b18-521ca1f74e24 req-e7d73ef0-206f-4542-9d78-346829f862b6 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8df72d82-b208-4f7c-8b18-521ca1f74e24 req-e7d73ef0-206f-4542-9d78-346829f862b6 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-8df72d82-b208-4f7c-8b18-521ca1f74e24 req-e7d73ef0-206f-4542-9d78-346829f862b6 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:30 user nova-compute[73079]: WARNING nova.compute.manager [req-8df72d82-b208-4f7c-8b18-521ca1f74e24 req-e7d73ef0-206f-4542-9d78-346829f862b6 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state powering-on.
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:30 user nova-compute[73079]: INFO nova.compute.manager [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Terminating instance
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:31 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Instance destroyed successfully.
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lazy-loading 'resources' on Instance uuid 42c5a511-402c-4712-a07e-1639512a7be9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-119783382',display_name='tempest-TestVolumeSwap-server-119783382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-119783382',id=9,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9uZL2tGdr7NwlrEQn3zDWETNa/kT5ZLDbn8D+1AbFNWX+lvnY2aKYtxcuMkzDqlHT+VOt98jrC9MEQUHPfMSHtohkDXCsd3SQ3lIRXUbku+mZaDWTMG3MCN3eYaLttZA==',key_name='tempest-keypair-1872370290',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4175b65eebba485d8ca232694926e428',ramdisk_id='',reservation_id='r-j5zla0sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-279138839',owner_user_name='tempest-TestVolumeSwap-279138839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e59b6ad093774f06a30ddf0285a63e95',uuid=42c5a511-402c-4712-a07e-1639512a7be9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Converting VIF {"id": "a569bdf5-76c8-4976-972c-0587421bac2f", "address": "fa:16:3e:ff:bc:39", "network": {"id": "b085f298-f567-4a21-9d19-9cbe8df342f6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257637338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4175b65eebba485d8ca232694926e428", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa569bdf5-76", "ovs_interfaceid": "a569bdf5-76c8-4976-972c-0587421bac2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG os_vif [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa569bdf5-76, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:31 user nova-compute[73079]: INFO os_vif [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:bc:39,bridge_name='br-int',has_traffic_filtering=True,id=a569bdf5-76c8-4976-972c-0587421bac2f,network=Network(b085f298-f567-4a21-9d19-9cbe8df342f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa569bdf5-76')
Aug 17 14:44:31 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Deleting instance files /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9_del
Aug 17 14:44:31 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Deletion of /opt/stack/data/nova/instances/42c5a511-402c-4712-a07e-1639512a7be9_del complete
Aug 17 14:44:31 user nova-compute[73079]: INFO nova.compute.manager [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 14:44:31 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283456.5683599, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:31 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Stopped (Lifecycle Event)
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ac2e7bb-5eed-4c12-a5e3-58a78f8e4b77 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ac2e7bb-5eed-4c12-a5e3-58a78f8e4b77 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:31 user nova-compute[73079]: INFO nova.compute.manager [None req-7ac2e7bb-5eed-4c12-a5e3-58a78f8e4b77 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:32 user nova-compute[73079]: WARNING nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state powering-on.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-vif-unplugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] No waiting events found dispatching network-vif-unplugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-vif-unplugged-a569bdf5-76c8-4976-972c-0587421bac2f for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Acquiring lock "42c5a511-402c-4712-a07e-1639512a7be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] Lock "42c5a511-402c-4712-a07e-1639512a7be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] No waiting events found dispatching network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:32 user nova-compute[73079]: WARNING nova.compute.manager [req-364a47e1-7c41-4f93-87d7-ec95e4c98728 req-50a1c24f-4a5e-4190-8bc6-e9677287e16e service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received unexpected event network-vif-plugged-a569bdf5-76c8-4976-972c-0587421bac2f for instance with vm_state active and task_state deleting.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd0f75be-34d4-4853-8bec-e5fbf695f751 req-84268eac-dbb0-4179-933a-c566dc9eefcb service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Received event network-vif-deleted-a569bdf5-76c8-4976-972c-0587421bac2f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.compute.manager [req-dd0f75be-34d4-4853-8bec-e5fbf695f751 req-84268eac-dbb0-4179-933a-c566dc9eefcb service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Neutron deleted interface a569bdf5-76c8-4976-972c-0587421bac2f; detaching it from the instance and deleting it from the info cache
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-dd0f75be-34d4-4853-8bec-e5fbf695f751 req-84268eac-dbb0-4179-933a-c566dc9eefcb service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Took 0.91 seconds to deallocate network for instance.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283472.4080215, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Resumed (Lifecycle Event)
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance rebooted successfully.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-aa367111-eaa7-4ca3-be5e-ac57423bf869 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd0f75be-34d4-4853-8bec-e5fbf695f751 req-84268eac-dbb0-4179-933a-c566dc9eefcb service nova] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Detach interface failed, port_id=a569bdf5-76c8-4976-972c-0587421bac2f, reason: Instance 42c5a511-402c-4712-a07e-1639512a7be9 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283472.4115283, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Started (Lifecycle Event)
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:44:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:32 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Deleted allocations for instance 42c5a511-402c-4712-a07e-1639512a7be9
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6d002129-e2b0-490a-8345-1a2dd5c00569 tempest-TestVolumeSwap-279138839 tempest-TestVolumeSwap-279138839-project-member] Lock "42c5a511-402c-4712-a07e-1639512a7be9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.571s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Starting finish_migration {{(pid=73079) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 14:44:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Creating image(s)
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk. size=21474836480 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk 21474836480 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk 21474836480" returned: 0 in 0.210s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Ensure instance console log exists: /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start _get_guest_xml network_info=[{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'b766e3dc-9038-480e-b948-940f3959ec90', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9d2c4290-ec0a-4dc3-8afa-552487ac923f', 'attached_at': '2023-08-17T14:44:33.000000', 'detached_at': '', 'volume_id': '2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783', 'serial': '2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:44:33 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:33 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:44:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:44:33 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc54ebd-728f-42fe-ae92-f791df3395fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:44:34 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ec75e0-4a17-4b67-8cd6-0c24b565d440]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783] added
Aug 17 14:44:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d293b7-a4d8-43a7-bef1-829204aa137d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a85a61-241e-4fe3-abb8-4bdb21eb4172]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWXhsifn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWXhsifn" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b84d76-fe8b-481e-98e0-7cc873e33dd1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YWXhsifn'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8524952b-28ea-489d-ae5a-33ab464931f4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ababc36-28b3-46b9-8edf-60e75f535d5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b5bd09-289e-49d0-bc90-3cf707ffa50a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]
Aug 17 14:44:34 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.
Aug 17 14:44:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f6ca8-16b2-4ea5-8e8b-44d864fcffbc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f182a4-b94a-427e-9d20-07a00d2fbd23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:44:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b9f79-b69b-4f8e-9912-67273062aa00]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23366383634666538', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366383634666538', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:44:35 user nova-compute[73079]:   <uuid>9d2c4290-ec0a-4dc3-8afa-552487ac923f</uuid>
Aug 17 14:44:35 user nova-compute[73079]:   <name>instance-00000003</name>
Aug 17 14:44:35 user nova-compute[73079]:   <memory>2097152</memory>
Aug 17 14:44:35 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:44:35 user nova-compute[73079]:   <metadata>
Aug 17 14:44:35 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:44:35 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:44:35 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherB-server-1550667638</nova:name>
Aug 17 14:44:35 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:44:33</nova:creationTime>
Aug 17 14:44:35 user nova-compute[73079]:       <nova:flavor name="m1.small">
Aug 17 14:44:35 user nova-compute[73079]:         <nova:memory>2048</nova:memory>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:disk>20</nova:disk>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:44:35 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:44:35 user nova-compute[73079]:       <nova:owner>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:user uuid="58b4647e94614c84a7b0b77de3aa4e03">tempest-ServerActionsTestOtherB-1211659744-project-member</nova:user>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:project uuid="a7fcbaf2803041bc9a038147e2d03356">tempest-ServerActionsTestOtherB-1211659744</nova:project>
Aug 17 14:44:35 user nova-compute[73079]:       </nova:owner>
Aug 17 14:44:35 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:44:35 user nova-compute[73079]:       <nova:ports>
Aug 17 14:44:35 user nova-compute[73079]:         <nova:port uuid="5955a467-f321-452d-812d-4796e5b7d6df">
Aug 17 14:44:35 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:44:35 user nova-compute[73079]:         </nova:port>
Aug 17 14:44:35 user nova-compute[73079]:       </nova:ports>
Aug 17 14:44:35 user nova-compute[73079]:     </nova:instance>
Aug 17 14:44:35 user nova-compute[73079]:   </metadata>
Aug 17 14:44:35 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:44:35 user nova-compute[73079]:     <system>
Aug 17 14:44:35 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:44:35 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:44:35 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:44:35 user nova-compute[73079]:       <entry name="serial">9d2c4290-ec0a-4dc3-8afa-552487ac923f</entry>
Aug 17 14:44:35 user nova-compute[73079]:       <entry name="uuid">9d2c4290-ec0a-4dc3-8afa-552487ac923f</entry>
Aug 17 14:44:35 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:44:35 user nova-compute[73079]:     </system>
Aug 17 14:44:35 user nova-compute[73079]:   </sysinfo>
Aug 17 14:44:35 user nova-compute[73079]:   <os>
Aug 17 14:44:35 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:44:35 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:44:35 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:44:35 user nova-compute[73079]:   </os>
Aug 17 14:44:35 user nova-compute[73079]:   <features>
Aug 17 14:44:35 user nova-compute[73079]:     <acpi/>
Aug 17 14:44:35 user nova-compute[73079]:     <apic/>
Aug 17 14:44:35 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:44:35 user nova-compute[73079]:   </features>
Aug 17 14:44:35 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:44:35 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:44:35 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:44:35 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:44:35 user nova-compute[73079]:   </clock>
Aug 17 14:44:35 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:44:35 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:44:35 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:44:35 user nova-compute[73079]:   </cpu>
Aug 17 14:44:35 user nova-compute[73079]:   <devices>
Aug 17 14:44:35 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:44:35 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:44:35 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk"/>
Aug 17 14:44:35 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:44:35 user nova-compute[73079]:     </disk>
Aug 17 14:44:35 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:44:35 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:44:35 user nova-compute[73079]:       <source dev="/dev/sde"/>
Aug 17 14:44:35 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:44:35 user nova-compute[73079]:       <serial>2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783</serial>
Aug 17 14:44:35 user nova-compute[73079]:     </disk>
Aug 17 14:44:35 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:44:35 user nova-compute[73079]:       <mac address="fa:16:3e:34:d7:35"/>
Aug 17 14:44:35 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:44:35 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:44:35 user nova-compute[73079]:       <target dev="tap5955a467-f3"/>
Aug 17 14:44:35 user nova-compute[73079]:     </interface>
Aug 17 14:44:35 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:44:35 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/console.log" append="off"/>
Aug 17 14:44:35 user nova-compute[73079]:     </serial>
Aug 17 14:44:35 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:44:35 user nova-compute[73079]:     <video>
Aug 17 14:44:35 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:44:35 user nova-compute[73079]:     </video>
Aug 17 14:44:35 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:44:35 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:44:35 user nova-compute[73079]:     </rng>
Aug 17 14:44:35 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:44:35 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:44:35 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:44:35 user nova-compute[73079]:     </memballoon>
Aug 17 14:44:35 user nova-compute[73079]:   </devices>
Aug 17 14:44:35 user nova-compute[73079]: </domain>
Aug 17 14:44:35 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1104186658-network", "vif_mac": "fa:16:3e:34:d7:35"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG os_vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5955a467-f3, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5955a467-f3, col_values=(('external_ids', {'iface-id': '5955a467-f321-452d-812d-4796e5b7d6df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:d7:35', 'vm-uuid': '9d2c4290-ec0a-4dc3-8afa-552487ac923f'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:35 user nova-compute[73079]: INFO os_vif [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3')
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] No VIF found with MAC fa:16:3e:34:d7:35, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-24df1ac4-f22b-4eca-a98a-17447d3c17b7 req-f0ac83c3-d79d-43f7-b4b2-5a015a551d63 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-24df1ac4-f22b-4eca-a98a-17447d3c17b7 req-f0ac83c3-d79d-43f7-b4b2-5a015a551d63 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-24df1ac4-f22b-4eca-a98a-17447d3c17b7 req-f0ac83c3-d79d-43f7-b4b2-5a015a551d63 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-24df1ac4-f22b-4eca-a98a-17447d3c17b7 req-f0ac83c3-d79d-43f7-b4b2-5a015a551d63 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-24df1ac4-f22b-4eca-a98a-17447d3c17b7 req-f0ac83c3-d79d-43f7-b4b2-5a015a551d63 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:37 user nova-compute[73079]: WARNING nova.compute.manager [req-24df1ac4-f22b-4eca-a98a-17447d3c17b7 req-f0ac83c3-d79d-43f7-b4b2-5a015a551d63 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state resize_finish.
Aug 17 14:44:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-620aef09-a9e9-4d60-be53-105f70d55603 req-aaad789b-c29a-4eab-bc9f-afad31193c42 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-620aef09-a9e9-4d60-be53-105f70d55603 req-aaad789b-c29a-4eab-bc9f-afad31193c42 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-620aef09-a9e9-4d60-be53-105f70d55603 req-aaad789b-c29a-4eab-bc9f-afad31193c42 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-620aef09-a9e9-4d60-be53-105f70d55603 req-aaad789b-c29a-4eab-bc9f-afad31193c42 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-620aef09-a9e9-4d60-be53-105f70d55603 req-aaad789b-c29a-4eab-bc9f-afad31193c42 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:44:40 user nova-compute[73079]: WARNING nova.compute.manager [req-620aef09-a9e9-4d60-be53-105f70d55603 req-aaad789b-c29a-4eab-bc9f-afad31193c42 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state resize_finish.
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283480.2722783, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Resumed (Lifecycle Event)
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:44:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance running successfully.
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Failed to set time: agent not configured {{(pid=73079) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8d99be0d-0f40-432b-a39f-78913a685e0e tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] finish_migration finished successfully. {{(pid=73079) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283480.273893, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Started (Lifecycle Event)
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:44:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 14:44:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:46 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283471.3188229, 42c5a511-402c-4712-a07e-1639512a7be9 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:44:46 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] VM Stopped (Lifecycle Event)
Aug 17 14:44:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6a2f6d8f-2f5d-44f1-a8dc-2e766e53bca0 None None] [instance: 42c5a511-402c-4712-a07e-1639512a7be9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:44:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:44:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:45:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:45:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:07 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:45:07 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=25.536197662353516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Applying migration context for instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f as it has an incoming, in-progress migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a. Migration status is finished {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 14:45:07 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating resource usage from migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a279bc96-247f-43e4-9d99-3dc690da4d0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cb8ad507-b5da-467c-8008-f43573b7e7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 89cd463e-6624-4963-8007-aa6094f7e890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:45:07 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 has allocations against this compute host but is not found in the database.
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.069s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:45:08 user nova-compute[73079]: INFO nova.compute.claims [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Claim successful on node user
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:45:08 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:45:08 user nova-compute[73079]: INFO nova.virt.block_device [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Booting with volume 0ae8ed0a-6053-46f5-adeb-f7fee6aca52f at /dev/vda
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.policy [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5961828bebbf4a8b9168d8e7f91fe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7065c3e6c348ae929d7a53011117a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG os_brick.utils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c6845c-580d-49f1-85d6-f9badd5f0ba9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cefe58-17fa-4cef-bab9-8f67db30eb9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7175ed7-8348-4ffb-b54d-d87af6db55bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e0406-fa47-4019-9e1a-cb3896b11427]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:45:08 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:45:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[66400755-58c8-4777-92ab-804a2d81dfc5]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG os_brick.utils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:45:08 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updating existing volume attachment record: 187a084e-cb43-417a-9fec-07a006692e9a {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:45:09 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Successfully created port: 17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Successfully updated port: 17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquired lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-changed-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Refreshing instance network info cache due to event network-changed-17ae6a67-9f51-487e-b36d-83690838779b. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] Acquiring lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updating instance_info_cache with network_info: [{"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Releasing lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance network_info: |[{"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] Acquired lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.network.neutron [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Refreshing network info cache for port 17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:10 user nova-compute[73079]: INFO nova.compute.manager [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Detaching volume 78c6cbf0-19b5-490b-95ae-ece07f037d57
Aug 17 14:45:10 user nova-compute[73079]: INFO nova.virt.block_device [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Attempting to driver detach volume 78c6cbf0-19b5-490b-95ae-ece07f037d57 from mountpoint /dev/vdb
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Attempting to detach device vdb from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:45:10 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:45:10 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:45:10 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:45:10 user nova-compute[73079]:   <serial>78c6cbf0-19b5-490b-95ae-ece07f037d57</serial>
Aug 17 14:45:10 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:45:10 user nova-compute[73079]: </disk>
Aug 17 14:45:10 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:45:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Successfully detached device vdb from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the persistent domain config.
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:45:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:45:10 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:45:10 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:45:10 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:45:10 user nova-compute[73079]:   <serial>78c6cbf0-19b5-490b-95ae-ece07f037d57</serial>
Aug 17 14:45:10 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:45:10 user nova-compute[73079]: </disk>
Aug 17 14:45:10 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG nova.network.neutron [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updated VIF entry in instance network info cache for port 17ae6a67-9f51-487e-b36d-83690838779b. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG nova.network.neutron [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updating instance_info_cache with network_info: [{"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a193839e-7028-4e8d-992c-5da2b0af11d1 req-efd525ec-feee-4211-858d-e5edd22ea31a service nova] Releasing lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283511.4613872, cb8ad507-b5da-467c-8008-f43573b7e7c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:45:11 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Successfully detached device vdb from instance cb8ad507-b5da-467c-8008-f43573b7e7c3 from the live domain config.
Aug 17 14:45:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIBRWpoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:45:11 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25cd84-eefe-496c-827f-2b231bb9a11a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2e1e00-78aa-410a-9622-3ffa8ab02441]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:45:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8655c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd742e6-c897-4283-9938-808d80ffd5cb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b019b-b0a5-48e3-baeb-ef250a9a2877]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c67ba-d8cc-41e4-83b9-506deec2ef9c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a10bc-6129-4f3c-9e4f-3a451ff524ab]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db264e1-1514-467d-bcfd-cbc75d850a57]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c5127-b193-4272-8b95-e2380e805d96]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260]
Aug 17 14:45:11 user nova-compute[73079]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57, portal: 172.16.0.220,3260] successful.
Aug 17 14:45:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c6cbf0-19b5-490b-95ae-ece07f037d57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33687314-e159-4304-9004-ce9829663e1f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] <== disconnect_volume: return (293ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:45:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:45:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'flavor' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:45:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0bb8c6c7-3612-4609-a14f-af24ae7a321e tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:45:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Creating image(s)
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Ensure instance console log exists: /opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Start _get_guest_xml network_info=[{"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '187a084e-cb43-417a-9fec-07a006692e9a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07c1ea4d-000b-4352-8284-5d2b1f1dfaa7', 'attached_at': '', 'detached_at': '', 'volume_id': '0ae8ed0a-6053-46f5-adeb-f7fee6aca52f', 'serial': '0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:45:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:45:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:45:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:45:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:45:20 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f925da54-2089-4c7f-b90d-3351e06d0dd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:45:20 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d7a7f4-d85d-4de0-845d-2011dd668a25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f] added
Aug 17 14:45:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d46f81-c02d-4d58-8871-98eeb576a9d9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b4cd0-ba38-4108-bc71-6f2f08b6872c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTPGKOdv {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTPGKOdv" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a738eb18-a196-4055-a494-fcc313557916]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTPGKOdv'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[be93bf9f-b391-46ca-b6f4-504c781408cc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea69106-604f-414a-9021-6df417ad2a15]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95a4ee7-e5e3-43f4-a3cf-4856e5be4b68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]
Aug 17 14:45:20 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.
Aug 17 14:45:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb353c-6575-433a-8309-38cb8671f14e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d9cfee-290f-4637-b8e8-7958a8e211ac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:45:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:45:20 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:45:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a436f1-f3db-45e5-8739-b5e4f80fae01]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:45:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23838613961343161', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838613961343161', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1807850676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1807850676',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq9zO9T/lSSvO4QLehADGZzJc7bYUBIPgnANEDieXE5JLP9mBiULljyHZTfMZqXKbWrnnui8Rk/GnLkz4Hv78LmqRtHLA9c24KJAQUpRVAqSLPws1XinirRIeFeYLuQag==',key_name='tempest-keypair-353563461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7065c3e6c348ae929d7a53011117a4',ramdisk_id='',reservation_id='r-0e3y0gw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1796114192',owner_user_name='tempest-ServerActionsV293TestJSON-1796114192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5961828bebbf4a8b9168d8e7f91fe738',uuid=07c1ea4d-000b-4352-8284-5d2b1f1dfaa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converting VIF {"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'pci_devices' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-changed-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing instance network info cache due to event network-changed-38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:45:21 user nova-compute[73079]:   <uuid>07c1ea4d-000b-4352-8284-5d2b1f1dfaa7</uuid>
Aug 17 14:45:21 user nova-compute[73079]:   <name>instance-0000000e</name>
Aug 17 14:45:21 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:45:21 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:45:21 user nova-compute[73079]:   <metadata>
Aug 17 14:45:21 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:45:21 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:45:21 user nova-compute[73079]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1807850676</nova:name>
Aug 17 14:45:21 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:45:20</nova:creationTime>
Aug 17 14:45:21 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:45:21 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:45:21 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:45:21 user nova-compute[73079]:       <nova:owner>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:user uuid="5961828bebbf4a8b9168d8e7f91fe738">tempest-ServerActionsV293TestJSON-1796114192-project-member</nova:user>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:project uuid="aa7065c3e6c348ae929d7a53011117a4">tempest-ServerActionsV293TestJSON-1796114192</nova:project>
Aug 17 14:45:21 user nova-compute[73079]:       </nova:owner>
Aug 17 14:45:21 user nova-compute[73079]:       <nova:ports>
Aug 17 14:45:21 user nova-compute[73079]:         <nova:port uuid="17ae6a67-9f51-487e-b36d-83690838779b">
Aug 17 14:45:21 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 14:45:21 user nova-compute[73079]:         </nova:port>
Aug 17 14:45:21 user nova-compute[73079]:       </nova:ports>
Aug 17 14:45:21 user nova-compute[73079]:     </nova:instance>
Aug 17 14:45:21 user nova-compute[73079]:   </metadata>
Aug 17 14:45:21 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:45:21 user nova-compute[73079]:     <system>
Aug 17 14:45:21 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:45:21 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:45:21 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:45:21 user nova-compute[73079]:       <entry name="serial">07c1ea4d-000b-4352-8284-5d2b1f1dfaa7</entry>
Aug 17 14:45:21 user nova-compute[73079]:       <entry name="uuid">07c1ea4d-000b-4352-8284-5d2b1f1dfaa7</entry>
Aug 17 14:45:21 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:45:21 user nova-compute[73079]:     </system>
Aug 17 14:45:21 user nova-compute[73079]:   </sysinfo>
Aug 17 14:45:21 user nova-compute[73079]:   <os>
Aug 17 14:45:21 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:45:21 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:45:21 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:45:21 user nova-compute[73079]:   </os>
Aug 17 14:45:21 user nova-compute[73079]:   <features>
Aug 17 14:45:21 user nova-compute[73079]:     <acpi/>
Aug 17 14:45:21 user nova-compute[73079]:     <apic/>
Aug 17 14:45:21 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:45:21 user nova-compute[73079]:   </features>
Aug 17 14:45:21 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:45:21 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:45:21 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:45:21 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:45:21 user nova-compute[73079]:   </clock>
Aug 17 14:45:21 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:45:21 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:45:21 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:45:21 user nova-compute[73079]:   </cpu>
Aug 17 14:45:21 user nova-compute[73079]:   <devices>
Aug 17 14:45:21 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:45:21 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:45:21 user nova-compute[73079]:       <source dev="/dev/sdc"/>
Aug 17 14:45:21 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:45:21 user nova-compute[73079]:       <serial>0ae8ed0a-6053-46f5-adeb-f7fee6aca52f</serial>
Aug 17 14:45:21 user nova-compute[73079]:     </disk>
Aug 17 14:45:21 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:45:21 user nova-compute[73079]:       <mac address="fa:16:3e:54:86:6a"/>
Aug 17 14:45:21 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:45:21 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:45:21 user nova-compute[73079]:       <target dev="tap17ae6a67-9f"/>
Aug 17 14:45:21 user nova-compute[73079]:     </interface>
Aug 17 14:45:21 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:45:21 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7/console.log" append="off"/>
Aug 17 14:45:21 user nova-compute[73079]:     </serial>
Aug 17 14:45:21 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:45:21 user nova-compute[73079]:     <video>
Aug 17 14:45:21 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:45:21 user nova-compute[73079]:     </video>
Aug 17 14:45:21 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:45:21 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:45:21 user nova-compute[73079]:     </rng>
Aug 17 14:45:21 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:45:21 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:45:21 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:45:21 user nova-compute[73079]:     </memballoon>
Aug 17 14:45:21 user nova-compute[73079]:   </devices>
Aug 17 14:45:21 user nova-compute[73079]: </domain>
Aug 17 14:45:21 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1807850676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1807850676',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq9zO9T/lSSvO4QLehADGZzJc7bYUBIPgnANEDieXE5JLP9mBiULljyHZTfMZqXKbWrnnui8Rk/GnLkz4Hv78LmqRtHLA9c24KJAQUpRVAqSLPws1XinirRIeFeYLuQag==',key_name='tempest-keypair-353563461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7065c3e6c348ae929d7a53011117a4',ramdisk_id='',reservation_id='r-0e3y0gw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1796114192',owner_user_name='tempest-ServerActionsV293TestJSON-1796114192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5961828bebbf4a8b9168d8e7f91fe738',uuid=07c1ea4d-000b-4352-8284-5d2b1f1dfaa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converting VIF {"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG os_vif [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17ae6a67-9f, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17ae6a67-9f, col_values=(('external_ids', {'iface-id': '17ae6a67-9f51-487e-b36d-83690838779b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:86:6a', 'vm-uuid': '07c1ea4d-000b-4352-8284-5d2b1f1dfaa7'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:21 user nova-compute[73079]: INFO os_vif [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f')
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:45:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] No VIF found with MAC fa:16:3e:54:86:6a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:45:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updated VIF entry in instance network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:45:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0cb2e307-eca6-46a0-890f-4a842b317989 req-b5e3c519-0c74-4140-8039-1acdd9b05d43 service nova] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-84604b2e-0c73-499a-b7f5-fa3437e52f4f req-35a83711-2a88-4fc0-bed5-5a5de01044cb service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-84604b2e-0c73-499a-b7f5-fa3437e52f4f req-35a83711-2a88-4fc0-bed5-5a5de01044cb service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-84604b2e-0c73-499a-b7f5-fa3437e52f4f req-35a83711-2a88-4fc0-bed5-5a5de01044cb service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-84604b2e-0c73-499a-b7f5-fa3437e52f4f req-35a83711-2a88-4fc0-bed5-5a5de01044cb service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-84604b2e-0c73-499a-b7f5-fa3437e52f4f req-35a83711-2a88-4fc0-bed5-5a5de01044cb service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:45:23 user nova-compute[73079]: WARNING nova.compute.manager [req-84604b2e-0c73-499a-b7f5-fa3437e52f4f req-35a83711-2a88-4fc0-bed5-5a5de01044cb service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state building and task_state spawning.
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283525.56193, 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] VM Resumed (Lifecycle Event)
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance spawned successfully.
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283525.5630963, 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] VM Started (Lifecycle Event)
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-8eec1f1b-1af5-4f60-8fec-5e22b35c6bfc req-d80dd249-f0ed-4de1-bb97-698a22fbec5d service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8eec1f1b-1af5-4f60-8fec-5e22b35c6bfc req-d80dd249-f0ed-4de1-bb97-698a22fbec5d service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8eec1f1b-1af5-4f60-8fec-5e22b35c6bfc req-d80dd249-f0ed-4de1-bb97-698a22fbec5d service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8eec1f1b-1af5-4f60-8fec-5e22b35c6bfc req-d80dd249-f0ed-4de1-bb97-698a22fbec5d service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-8eec1f1b-1af5-4f60-8fec-5e22b35c6bfc req-d80dd249-f0ed-4de1-bb97-698a22fbec5d service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:45:25 user nova-compute[73079]: WARNING nova.compute.manager [req-8eec1f1b-1af5-4f60-8fec-5e22b35c6bfc req-d80dd249-f0ed-4de1-bb97-698a22fbec5d service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state building and task_state spawning.
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 17 14:45:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:25 user nova-compute[73079]: INFO nova.compute.manager [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Took 17.84 seconds to build instance.
Aug 17 14:45:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e30613ec-9c82-47ef-8439-5d0885a58a91 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.958s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:27 user nova-compute[73079]: INFO nova.compute.manager [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Shelving
Aug 17 14:45:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-a55ae5d9-cfea-417e-935c-59c1b2035a0c req-2962fb98-83d0-4596-a31d-4da2b00dee8e service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-unplugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a55ae5d9-cfea-417e-935c-59c1b2035a0c req-2962fb98-83d0-4596-a31d-4da2b00dee8e service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a55ae5d9-cfea-417e-935c-59c1b2035a0c req-2962fb98-83d0-4596-a31d-4da2b00dee8e service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a55ae5d9-cfea-417e-935c-59c1b2035a0c req-2962fb98-83d0-4596-a31d-4da2b00dee8e service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-a55ae5d9-cfea-417e-935c-59c1b2035a0c req-2962fb98-83d0-4596-a31d-4da2b00dee8e service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-unplugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:45:28 user nova-compute[73079]: WARNING nova.compute.manager [req-a55ae5d9-cfea-417e-935c-59c1b2035a0c req-2962fb98-83d0-4596-a31d-4da2b00dee8e service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-unplugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state active and task_state shelving.
Aug 17 14:45:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance destroyed successfully.
Aug 17 14:45:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Beginning cold snapshot process
Aug 17 14:45:28 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:45:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk /opt/stack/data/nova/instances/snapshots/tmpl7c4_5ut/8b8286d5d3a9440c8f2ce1691a59dd1a {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:45:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk /opt/stack/data/nova/instances/snapshots/tmpl7c4_5ut/8b8286d5d3a9440c8f2ce1691a59dd1a" returned: 0 in 0.806s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:45:29 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Snapshot extracted, beginning image upload
Aug 17 14:45:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7c3cb13-eba9-40f4-8d23-14c0bc68c8d8 req-6d45e5f6-da6f-4b3b-80d5-5fcbb65da7e3 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7c3cb13-eba9-40f4-8d23-14c0bc68c8d8 req-6d45e5f6-da6f-4b3b-80d5-5fcbb65da7e3 service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7c3cb13-eba9-40f4-8d23-14c0bc68c8d8 req-6d45e5f6-da6f-4b3b-80d5-5fcbb65da7e3 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7c3cb13-eba9-40f4-8d23-14c0bc68c8d8 req-6d45e5f6-da6f-4b3b-80d5-5fcbb65da7e3 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7c3cb13-eba9-40f4-8d23-14c0bc68c8d8 req-6d45e5f6-da6f-4b3b-80d5-5fcbb65da7e3 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:45:30 user nova-compute[73079]: WARNING nova.compute.manager [req-d7c3cb13-eba9-40f4-8d23-14c0bc68c8d8 req-6d45e5f6-da6f-4b3b-80d5-5fcbb65da7e3 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 14:45:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Snapshot image upload complete
Aug 17 14:45:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:32 user nova-compute[73079]: INFO nova.compute.manager [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Shelve offloading
Aug 17 14:45:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance destroyed successfully.
Aug 17 14:45:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:45:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:45:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance destroyed successfully.
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'resources' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1662234110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1662234110',id=12,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEilashB2BPL+es6WZoI8bJdKCPPyqoAL9bLN6jMjig7DSRb+5ktF80nPIgKjR1+keFKd+VUCMuVzSbEmj0FdeA0GkPBJ8wiruIQMze7tZ3+8USog9SCui1puZNu/HxxnQ==',key_name='tempest-keypair-1562296241',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-ufol2uj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member',shelved_at='2023-08-17T14:45:32.701912',shelved_host='user',shelved_image_id='d4c09f01-b2dc-4b86-ac3f-bf40559f698f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=dcef5f40-f1b3-4fcb-8875-c8e749fc63c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG os_vif [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-changed-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing instance network info cache due to event network-changed-38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38eb71bf-50, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:45:34 user nova-compute[73079]: INFO os_vif [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50')
Aug 17 14:45:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Deleting instance files /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1_del
Aug 17 14:45:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Deletion of /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1_del complete
Aug 17 14:45:34 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Deleted allocations for instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'numa_topology' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updated VIF entry in instance network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap38eb71bf-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1c3cd9af-9150-4c75-82ea-e7cca70717c1 req-cead3060-a53e-4730-adf6-440303b92a15 service nova] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:45:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9018a23d-87fe-4e53-8b6a-f1e00b797d0c tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.810s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "89cd463e-6624-4963-8007-aa6094f7e890" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:37 user nova-compute[73079]: INFO nova.compute.manager [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Terminating instance
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-884a2cdc-c01f-47f2-b57f-41ce6543b66c req-4c489f5c-aec7-4c16-aa1a-79893e9ec2d1 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-vif-unplugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-884a2cdc-c01f-47f2-b57f-41ce6543b66c req-4c489f5c-aec7-4c16-aa1a-79893e9ec2d1 service nova] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-884a2cdc-c01f-47f2-b57f-41ce6543b66c req-4c489f5c-aec7-4c16-aa1a-79893e9ec2d1 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-884a2cdc-c01f-47f2-b57f-41ce6543b66c req-4c489f5c-aec7-4c16-aa1a-79893e9ec2d1 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-884a2cdc-c01f-47f2-b57f-41ce6543b66c req-4c489f5c-aec7-4c16-aa1a-79893e9ec2d1 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] No waiting events found dispatching network-vif-unplugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-884a2cdc-c01f-47f2-b57f-41ce6543b66c req-4c489f5c-aec7-4c16-aa1a-79893e9ec2d1 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-vif-unplugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:45:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Instance destroyed successfully.
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'resources' on Instance uuid 89cd463e-6624-4963-8007-aa6094f7e890 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:43:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-593568480',display_name='tempest-VolumesAdminNegativeTest-server-593568480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-593568480',id=13,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:43:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd3cf39349f140cb962abc3857c8b7c0',ramdisk_id='',reservation_id='r-0xn6znb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-385938588',owner_user_name='tempest-VolumesAdminNegativeTest-385938588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:43:42Z,user_data=None,user_id='a0e2a779916a4463a819fa223bb0af42',uuid=89cd463e-6624-4963-8007-aa6094f7e890,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converting VIF {"id": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "address": "fa:16:3e:a7:10:32", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ccf611-f9", "ovs_interfaceid": "c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG os_vif [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8ccf611-f9, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:45:37 user nova-compute[73079]: INFO os_vif [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:10:32,bridge_name='br-int',has_traffic_filtering=True,id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ccf611-f9')
Aug 17 14:45:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Deleting instance files /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890_del
Aug 17 14:45:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Deletion of /opt/stack/data/nova/instances/89cd463e-6624-4963-8007-aa6094f7e890_del complete
Aug 17 14:45:37 user nova-compute[73079]: INFO nova.compute.manager [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 17 14:45:37 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:45:37 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:45:38 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:38 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Took 0.51 seconds to deallocate network for instance.
Aug 17 14:45:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-dfbdcaaa-e51c-48c1-8ff7-4a2db54e9050 req-05d4935a-7d3b-4c36-9049-0ff4c1fd5789 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-vif-deleted-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:38 user nova-compute[73079]: INFO nova.compute.manager [req-dfbdcaaa-e51c-48c1-8ff7-4a2db54e9050 req-05d4935a-7d3b-4c36-9049-0ff4c1fd5789 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Neutron deleted interface c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1; detaching it from the instance and deleting it from the info cache
Aug 17 14:45:38 user nova-compute[73079]: DEBUG nova.network.neutron [req-dfbdcaaa-e51c-48c1-8ff7-4a2db54e9050 req-05d4935a-7d3b-4c36-9049-0ff4c1fd5789 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:45:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-dfbdcaaa-e51c-48c1-8ff7-4a2db54e9050 req-05d4935a-7d3b-4c36-9049-0ff4c1fd5789 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Detach interface failed, port_id=c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1, reason: Instance 89cd463e-6624-4963-8007-aa6094f7e890 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:45:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:38 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:45:38 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:45:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:39 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Deleted allocations for instance 89cd463e-6624-4963-8007-aa6094f7e890
Aug 17 14:45:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a7f4c564-e80c-429e-8576-6fcad86853d2 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "89cd463e-6624-4963-8007-aa6094f7e890" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4132f0ee-3051-4b3d-918b-98d7b1aa090d req-af74dbc5-e7ea-433d-8866-d05a5eed8b84 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received event network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:45:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4132f0ee-3051-4b3d-918b-98d7b1aa090d req-af74dbc5-e7ea-433d-8866-d05a5eed8b84 service nova] Acquiring lock "89cd463e-6624-4963-8007-aa6094f7e890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:45:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4132f0ee-3051-4b3d-918b-98d7b1aa090d req-af74dbc5-e7ea-433d-8866-d05a5eed8b84 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:45:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4132f0ee-3051-4b3d-918b-98d7b1aa090d req-af74dbc5-e7ea-433d-8866-d05a5eed8b84 service nova] Lock "89cd463e-6624-4963-8007-aa6094f7e890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:45:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4132f0ee-3051-4b3d-918b-98d7b1aa090d req-af74dbc5-e7ea-433d-8866-d05a5eed8b84 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] No waiting events found dispatching network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:45:39 user nova-compute[73079]: WARNING nova.compute.manager [req-4132f0ee-3051-4b3d-918b-98d7b1aa090d req-af74dbc5-e7ea-433d-8866-d05a5eed8b84 service nova] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Received unexpected event network-vif-plugged-c8ccf611-f9ff-481c-80d4-cbb0c9dcf0c1 for instance with vm_state deleted and task_state None.
Aug 17 14:45:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:43 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283528.6054235, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:45:43 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] VM Stopped (Lifecycle Event)
Aug 17 14:45:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-62a85d8c-3f6a-4290-83c2-33b34e16aa1e None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:52 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283537.8700814, 89cd463e-6624-4963-8007-aa6094f7e890 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:45:52 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] VM Stopped (Lifecycle Event)
Aug 17 14:45:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4240e0a5-3b96-44c8-8813-e6926eae89b0 None None] [instance: 89cd463e-6624-4963-8007-aa6094f7e890] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:45:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 14:45:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:45:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 14:45:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 14:45:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:45:59 user nova-compute[73079]: INFO nova.compute.manager [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Unrescuing
Aug 17 14:45:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:45:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:45:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'flavor' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing instance network info cache due to event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.network.neutron [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:01 user nova-compute[73079]: INFO nova.compute.manager [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Terminating instance
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:46:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance destroyed successfully.
Aug 17 14:46:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-197d6ce5-4b53-48da-904e-5123bfb24ade req-ff1dfe8a-2fb4-4e21-addd-cb77f0b8fa8a service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-vif-unplugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-197d6ce5-4b53-48da-904e-5123bfb24ade req-ff1dfe8a-2fb4-4e21-addd-cb77f0b8fa8a service nova] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-197d6ce5-4b53-48da-904e-5123bfb24ade req-ff1dfe8a-2fb4-4e21-addd-cb77f0b8fa8a service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-197d6ce5-4b53-48da-904e-5123bfb24ade req-ff1dfe8a-2fb4-4e21-addd-cb77f0b8fa8a service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-197d6ce5-4b53-48da-904e-5123bfb24ade req-ff1dfe8a-2fb4-4e21-addd-cb77f0b8fa8a service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] No waiting events found dispatching network-vif-unplugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-197d6ce5-4b53-48da-904e-5123bfb24ade req-ff1dfe8a-2fb4-4e21-addd-cb77f0b8fa8a service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-vif-unplugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.network.neutron [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updated VIF entry in instance network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG nova.network.neutron [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2991ebd2-93b4-4a3b-8de5-2872cc065bbe req-2d3d9c02-ce92-428f-aab7-495546d25fef service nova] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Instance destroyed successfully.
Aug 17 14:46:02 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lazy-loading 'resources' on Instance uuid cb8ad507-b5da-467c-8008-f43573b7e7c3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:41:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-449073019',display_name='tempest-TestServerVolumeAttachmentScenario-server-449073019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-449073019',id=10,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcNzZ1rL+YlDhR+dp59DyHk6W1wXGtQmREYjfdO/vKADHdNr18VvhXiep3vohm/NnqrA28cp25mSfyIw9+CnaXgFe6fd/XA+S6sfoxi9Lkiw1siQRLyI0CQjjEkP+uJeA==',key_name='tempest-keypair-175156898',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='122c3c85977340e38328d6b9a690c768',ramdisk_id='',reservation_id='r-yjg8gz8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1636072611',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1636072611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e0b70013a36432dbf4d68815c643084',uuid=cb8ad507-b5da-467c-8008-f43573b7e7c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Converting VIF {"id": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "address": "fa:16:3e:19:b6:62", "network": {"id": "26ad692a-450d-4eb6-952b-eab2e5ef90a5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1970957946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "122c3c85977340e38328d6b9a690c768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f2b56eb-a2", "ovs_interfaceid": "2f2b56eb-a29f-4159-a45d-7cc7cd2eea80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG os_vif [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f2b56eb-a2, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:02 user nova-compute[73079]: INFO os_vif [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:b6:62,bridge_name='br-int',has_traffic_filtering=True,id=2f2b56eb-a29f-4159-a45d-7cc7cd2eea80,network=Network(26ad692a-450d-4eb6-952b-eab2e5ef90a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f2b56eb-a2')
Aug 17 14:46:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Deleting instance files /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3_del
Aug 17 14:46:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Deletion of /opt/stack/data/nova/instances/cb8ad507-b5da-467c-8008-f43573b7e7c3_del complete
Aug 17 14:46:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:02 user nova-compute[73079]: INFO nova.compute.manager [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 17 14:46:02 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing instance network info cache due to event network-changed-c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] Acquiring lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] Acquired lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.network.neutron [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Refreshing network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:03 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Took 1.52 seconds to deallocate network for instance.
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a063322-cfe9-4a6c-abf9-c350f9508df2 req-da83a02f-958d-4ab7-85dc-f8e52652740f service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a063322-cfe9-4a6c-abf9-c350f9508df2 req-da83a02f-958d-4ab7-85dc-f8e52652740f service nova] Acquiring lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a063322-cfe9-4a6c-abf9-c350f9508df2 req-da83a02f-958d-4ab7-85dc-f8e52652740f service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a063322-cfe9-4a6c-abf9-c350f9508df2 req-da83a02f-958d-4ab7-85dc-f8e52652740f service nova] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a063322-cfe9-4a6c-abf9-c350f9508df2 req-da83a02f-958d-4ab7-85dc-f8e52652740f service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] No waiting events found dispatching network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:03 user nova-compute[73079]: WARNING nova.compute.manager [req-7a063322-cfe9-4a6c-abf9-c350f9508df2 req-da83a02f-958d-4ab7-85dc-f8e52652740f service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received unexpected event network-vif-plugged-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 for instance with vm_state active and task_state deleting.
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updated VIF entry in instance network info cache for port c19575ab-dfc7-4e70-ac23-4a37a0044152. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [{"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f80a11e-b090-455d-b0f2-2fa091e105b0 req-633996e3-b68d-4128-97fe-223df31afc7e service nova] Releasing lock "refresh_cache-02f2d969-22f4-4785-a5e2-c805d45256b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Port 5955a467-f321-452d-812d-4796e5b7d6df binding to destination host user is already ACTIVE {{(pid=73079) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updating instance_info_cache with network_info: [{"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-a279bc96-247f-43e4-9d99-3dc690da4d0a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.746s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:46:04 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Deleted allocations for instance cb8ad507-b5da-467c-8008-f43573b7e7c3
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e672ab0f-e2e1-4a3c-ab10-2392dff8b86c tempest-TestServerVolumeAttachmentScenario-1636072611 tempest-TestServerVolumeAttachmentScenario-1636072611-project-member] Lock "cb8ad507-b5da-467c-8008-f43573b7e7c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.614s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Creating tmpfile /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/tmpgb7el0kk to verify with other compute node that the instance is on the same shared storage. {{(pid=73079) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-915342f8-d474-4be3-833b-13f351e9aaf9 req-3e4499eb-8196-401d-bfa1-1b3d84784e84 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-915342f8-d474-4be3-833b-13f351e9aaf9 req-3e4499eb-8196-401d-bfa1-1b3d84784e84 service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-915342f8-d474-4be3-833b-13f351e9aaf9 req-3e4499eb-8196-401d-bfa1-1b3d84784e84 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-915342f8-d474-4be3-833b-13f351e9aaf9 req-3e4499eb-8196-401d-bfa1-1b3d84784e84 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-915342f8-d474-4be3-833b-13f351e9aaf9 req-3e4499eb-8196-401d-bfa1-1b3d84784e84 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:05 user nova-compute[73079]: WARNING nova.compute.manager [req-915342f8-d474-4be3-833b-13f351e9aaf9 req-3e4499eb-8196-401d-bfa1-1b3d84784e84 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-5a32966b-65c4-4119-9027-1fd286f3c778 req-89613329-8444-414e-b794-00d9e85a0b68 service nova] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Received event network-vif-deleted-2f2b56eb-a29f-4159-a45d-7cc7cd2eea80 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 02f2d969-22f4-4785-a5e2-c805d45256b3 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283565.7612967, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:05 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Resumed (Lifecycle Event)
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a207f48c-56ff-434d-8427-d42ab97dfbc9 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:05 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283565.765093, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:05 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Started (Lifecycle Event)
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance destroyed successfully.
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'resources' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:44:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG os_vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5955a467-f3, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:46:06 user nova-compute[73079]: INFO os_vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3')
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:46:06 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3980a6-ad90-4909-badc-64d01040b219]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:06 user nova-compute[73079]: WARNING nova.compute.manager [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state resized and task_state resize_reverting.
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:06 user nova-compute[73079]: WARNING nova.compute.manager [req-fc3e026b-8b22-4b38-8e20-4522bc04c375 req-1538ba88-ee45-4a8d-8291-83fe1099483b service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state resized and task_state resize_reverting.
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[089cbebf-7b49-472a-b925-be2b59bfe475]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:06 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:46:06 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:46:06 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:06 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:06 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:46:06 user nova-compute[73079]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:46:06 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:06 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f7847760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3d2512-13f0-47ee-9de5-9e947d60d56d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1ed2a1-4897-4052-94a5-30b1362835c4]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cfccf8-ebe0-47e2-8d3a-954a54e9d60c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6132b8-ba66-417d-9ee0-20f7e76f0ab1]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab24ce1-8af0-401c-89c8-26c348bb3be9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b9bd78-2df2-4e94-a5ec-1e3af07a66ba]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]
Aug 17 14:46:06 user nova-compute[73079]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.
Aug 17 14:46:06 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0003a08-d563-4174-ad04-c1cb187e9eeb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== disconnect_volume: return (400ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:07 user nova-compute[73079]: WARNING nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state None.
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:07 user nova-compute[73079]: WARNING nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state None.
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:07 user nova-compute[73079]: WARNING nova.compute.manager [req-acb61e2e-79d4-4aa3-a705-abcdb7f48907 req-9bd02a96-977a-49ae-93c7-0638a956e43b service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state active and task_state None.
Aug 17 14:46:07 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:46:07 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=25.556854248046875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Applying migration context for instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f as it has an incoming, in-progress migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a. Migration status is reverting {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 14:46:07 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating resource usage from migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a279bc96-247f-43e4-9d99-3dc690da4d0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:46:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'migration_context' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:10 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:46:10 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:46:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.351s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:11 user nova-compute[73079]: INFO nova.compute.manager [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Swapping old allocation on dict_keys(['dea4593c-fa71-4579-88eb-51499faa7caf']) held by migration 1c7d27d1-ec24-476a-b67c-ceb84aefab2a for instance
Aug 17 14:46:11 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Overwriting current allocation {'allocations': {'dea4593c-fa71-4579-88eb-51499faa7caf': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 18}}, 'project_id': 'a7fcbaf2803041bc9a038147e2d03356', 'user_id': '58b4647e94614c84a7b0b77de3aa4e03', 'consumer_generation': 1} on consumer 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquired lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Releasing lock "refresh_cache-9d2c4290-ec0a-4dc3-8afa-552487ac923f" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG os_brick.utils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e6d50a-69ce-480a-bbe3-a26b6c25e1ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575bc13-bc61-4b58-843f-5efc16593073]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6087265-7e96-4da1-8868-6936d7321ce2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[698fb75d-133e-4503-9c7d-9e05fc33ed99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:46:12 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:46:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944a5b6-98b2-4a5d-9372-4cd4516077c9]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:46:12 user nova-compute[73079]: DEBUG os_brick.utils [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:46:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:16 user nova-compute[73079]: INFO nova.compute.manager [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Detaching volume 4a126b6f-9390-435a-89a1-fa19e9b3e107
Aug 17 14:46:16 user nova-compute[73079]: INFO nova.virt.block_device [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Attempting to driver detach volume 4a126b6f-9390-435a-89a1-fa19e9b3e107 from mountpoint /dev/vdb
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Attempting to detach device vdb from instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:46:16 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:46:16 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:46:16 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:46:16 user nova-compute[73079]:   <serial>4a126b6f-9390-435a-89a1-fa19e9b3e107</serial>
Aug 17 14:46:16 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 14:46:16 user nova-compute[73079]: </disk>
Aug 17 14:46:16 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:46:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully detached device vdb from instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a from the persistent domain config.
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:46:16 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:46:16 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:46:16 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:46:16 user nova-compute[73079]:   <serial>4a126b6f-9390-435a-89a1-fa19e9b3e107</serial>
Aug 17 14:46:16 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 14:46:16 user nova-compute[73079]: </disk>
Aug 17 14:46:16 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283576.7151082, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:46:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully detached device vdb from instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a from the live domain config.
Aug 17 14:46:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wNrnIuoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:46:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79ab0c-6cc2-4dd0-99b5-2770e9ed1be1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd81bea8-6dbb-418d-9dc9-c51cef1a59ce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:16 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:46:16 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:16 user nova-compute[73079]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 (non-flash)
Aug 17 14:46:16 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f796d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a35081-0729-4871-8a5e-31a6fd099cc2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc238f1-a81e-4885-9d80-dba283fbed49]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8018ec2-e554-4edb-93e4-4550af8dc3ef]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[093fe7b6-3fd4-4468-8ccb-0add0fa5bab9]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33170d3a-0062-4042-bb5f-aa915e5b1430]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e64e379-db45-43c0-9c93-92c3faa1779a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260]
Aug 17 14:46:17 user nova-compute[73079]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107, portal: 172.16.0.220,3260] successful.
Aug 17 14:46:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a126b6f-9390-435a-89a1-fa19e9b3e107 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f83585-3eb2-46aa-831b-89720b3519a5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== disconnect_volume: return (315ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283562.2840307, cb8ad507-b5da-467c-8008-f43573b7e7c3 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:17 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] VM Stopped (Lifecycle Event)
Aug 17 14:46:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8d30776c-1a8f-4d46-9eeb-153a1984111c None None] [instance: cb8ad507-b5da-467c-8008-f43573b7e7c3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b89e1794-0cea-430e-932a-96fd298f76c8 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.840s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73079) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-14cc2766-c6f8-48f5-bf88-53a223b0353f req-072530ad-4330-4fd9-982e-577bb36ccc66 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-14cc2766-c6f8-48f5-bf88-53a223b0353f req-072530ad-4330-4fd9-982e-577bb36ccc66 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-14cc2766-c6f8-48f5-bf88-53a223b0353f req-072530ad-4330-4fd9-982e-577bb36ccc66 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-14cc2766-c6f8-48f5-bf88-53a223b0353f req-072530ad-4330-4fd9-982e-577bb36ccc66 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-14cc2766-c6f8-48f5-bf88-53a223b0353f req-072530ad-4330-4fd9-982e-577bb36ccc66 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:19 user nova-compute[73079]: WARNING nova.compute.manager [req-14cc2766-c6f8-48f5-bf88-53a223b0353f req-072530ad-4330-4fd9-982e-577bb36ccc66 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state active and task_state powering-off.
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:19 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance destroyed successfully.
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:46:19 user nova-compute[73079]: INFO nova.compute.claims [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Claim successful on node user
Aug 17 14:46:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38d653dd-8222-4331-a9b3-0f4437338434 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.010s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:46:19 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:46:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.policy [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cea43fd4553b425b85b6eb25a066055d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47957ef1019a4623ac6bf81921f1619d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:46:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Creating image(s)
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk 1073741824" returned: 0 in 0.050s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Successfully created port: 1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:46:20 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283565.8733838, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:20 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Stopped (Lifecycle Event)
Aug 17 14:46:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-89c6509e-a754-40eb-ba07-779ee72e3d27 None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Cannot resize image /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'migration_context' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Ensure instance console log exists: /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f67c81f-bda1-48c8-8df2-d913d7c5753e req-6b381b8c-8c93-45c4-b6a8-4cc88d853f33 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f67c81f-bda1-48c8-8df2-d913d7c5753e req-6b381b8c-8c93-45c4-b6a8-4cc88d853f33 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f67c81f-bda1-48c8-8df2-d913d7c5753e req-6b381b8c-8c93-45c4-b6a8-4cc88d853f33 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f67c81f-bda1-48c8-8df2-d913d7c5753e req-6b381b8c-8c93-45c4-b6a8-4cc88d853f33 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f67c81f-bda1-48c8-8df2-d913d7c5753e req-6b381b8c-8c93-45c4-b6a8-4cc88d853f33 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:21 user nova-compute[73079]: WARNING nova.compute.manager [req-3f67c81f-bda1-48c8-8df2-d913d7c5753e req-6b381b8c-8c93-45c4-b6a8-4cc88d853f33 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state None.
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Successfully updated port: 1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquired lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-changed-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Refreshing instance network info cache due to event network-changed-1ece65d3-f2d3-4e2d-999c-e91c5d08441f. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] Acquiring lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Releasing lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Instance network_info: |[{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] Acquired lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Refreshing network info cache for port 1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Start _get_guest_xml network_info=[{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:46:22 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:46:22 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'pci_devices' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:46:22 user nova-compute[73079]:   <uuid>e9d53810-409d-41d6-bae3-b30937b21b25</uuid>
Aug 17 14:46:22 user nova-compute[73079]:   <name>instance-0000000f</name>
Aug 17 14:46:22 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:46:22 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:46:22 user nova-compute[73079]:   <metadata>
Aug 17 14:46:22 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:46:22 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:46:22 user nova-compute[73079]:       <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:46:22 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:46:22</nova:creationTime>
Aug 17 14:46:22 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:46:22 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:46:22 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:46:22 user nova-compute[73079]:       <nova:owner>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:46:22 user nova-compute[73079]:       </nova:owner>
Aug 17 14:46:22 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:46:22 user nova-compute[73079]:       <nova:ports>
Aug 17 14:46:22 user nova-compute[73079]:         <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:46:22 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:46:22 user nova-compute[73079]:         </nova:port>
Aug 17 14:46:22 user nova-compute[73079]:       </nova:ports>
Aug 17 14:46:22 user nova-compute[73079]:     </nova:instance>
Aug 17 14:46:22 user nova-compute[73079]:   </metadata>
Aug 17 14:46:22 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:46:22 user nova-compute[73079]:     <system>
Aug 17 14:46:22 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:46:22 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:46:22 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:46:22 user nova-compute[73079]:       <entry name="serial">e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:46:22 user nova-compute[73079]:       <entry name="uuid">e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:46:22 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:46:22 user nova-compute[73079]:     </system>
Aug 17 14:46:22 user nova-compute[73079]:   </sysinfo>
Aug 17 14:46:22 user nova-compute[73079]:   <os>
Aug 17 14:46:22 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:46:22 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:46:22 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:46:22 user nova-compute[73079]:   </os>
Aug 17 14:46:22 user nova-compute[73079]:   <features>
Aug 17 14:46:22 user nova-compute[73079]:     <acpi/>
Aug 17 14:46:22 user nova-compute[73079]:     <apic/>
Aug 17 14:46:22 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:46:22 user nova-compute[73079]:   </features>
Aug 17 14:46:22 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:46:22 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:46:22 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:46:22 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:46:22 user nova-compute[73079]:   </clock>
Aug 17 14:46:22 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:46:22 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:46:22 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:46:22 user nova-compute[73079]:   </cpu>
Aug 17 14:46:22 user nova-compute[73079]:   <devices>
Aug 17 14:46:22 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:46:22 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:46:22 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk"/>
Aug 17 14:46:22 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:46:22 user nova-compute[73079]:     </disk>
Aug 17 14:46:22 user nova-compute[73079]:     <disk type="file" device="cdrom">
Aug 17 14:46:22 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 14:46:22 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config"/>
Aug 17 14:46:22 user nova-compute[73079]:       <target dev="hda" bus="ide"/>
Aug 17 14:46:22 user nova-compute[73079]:     </disk>
Aug 17 14:46:22 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:46:22 user nova-compute[73079]:       <mac address="fa:16:3e:40:bc:c2"/>
Aug 17 14:46:22 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:46:22 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:46:22 user nova-compute[73079]:       <target dev="tap1ece65d3-f2"/>
Aug 17 14:46:22 user nova-compute[73079]:     </interface>
Aug 17 14:46:22 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:46:22 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log" append="off"/>
Aug 17 14:46:22 user nova-compute[73079]:     </serial>
Aug 17 14:46:22 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:46:22 user nova-compute[73079]:     <video>
Aug 17 14:46:22 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:46:22 user nova-compute[73079]:     </video>
Aug 17 14:46:22 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:46:22 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:46:22 user nova-compute[73079]:     </rng>
Aug 17 14:46:22 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:46:22 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:46:22 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:46:22 user nova-compute[73079]:     </memballoon>
Aug 17 14:46:22 user nova-compute[73079]:   </devices>
Aug 17 14:46:22 user nova-compute[73079]: </domain>
Aug 17 14:46:22 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG os_vif [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ece65d3-f2, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ece65d3-f2, col_values=(('external_ids', {'iface-id': '1ece65d3-f2d3-4e2d-999c-e91c5d08441f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:bc:c2', 'vm-uuid': 'e9d53810-409d-41d6-bae3-b30937b21b25'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:22 user nova-compute[73079]: INFO os_vif [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2')
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No BDM found with device name hda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No VIF found with MAC fa:16:3e:40:bc:c2, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:46:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Using config drive
Aug 17 14:46:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Creating config drive at /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config
Aug 17 14:46:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfcqlon12 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfcqlon12" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updated VIF entry in instance network info cache for port 1ece65d3-f2d3-4e2d-999c-e91c5d08441f. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6108ea08-9d71-4523-92a4-0420dc573ea0 req-e4ec2761-a87b-4acf-bb87-4da6dbac51e3 service nova] Releasing lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-35530035-6701-450b-bf97-e3b9d2a317e5 req-8cedbc7d-b534-471d-958c-7009cb58867f service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-35530035-6701-450b-bf97-e3b9d2a317e5 req-8cedbc7d-b534-471d-958c-7009cb58867f service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-35530035-6701-450b-bf97-e3b9d2a317e5 req-8cedbc7d-b534-471d-958c-7009cb58867f service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-35530035-6701-450b-bf97-e3b9d2a317e5 req-8cedbc7d-b534-471d-958c-7009cb58867f service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-35530035-6701-450b-bf97-e3b9d2a317e5 req-8cedbc7d-b534-471d-958c-7009cb58867f service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:23 user nova-compute[73079]: WARNING nova.compute.manager [req-35530035-6701-450b-bf97-e3b9d2a317e5 req-8cedbc7d-b534-471d-958c-7009cb58867f service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f for instance with vm_state building and task_state spawning.
Aug 17 14:46:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0f0b7937-ac17-4721-94e2-fa690558673a req-c307368e-ff00-4686-8225-4cf45472a34f service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0f0b7937-ac17-4721-94e2-fa690558673a req-c307368e-ff00-4686-8225-4cf45472a34f service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0f0b7937-ac17-4721-94e2-fa690558673a req-c307368e-ff00-4686-8225-4cf45472a34f service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0f0b7937-ac17-4721-94e2-fa690558673a req-c307368e-ff00-4686-8225-4cf45472a34f service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0f0b7937-ac17-4721-94e2-fa690558673a req-c307368e-ff00-4686-8225-4cf45472a34f service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:26 user nova-compute[73079]: WARNING nova.compute.manager [req-0f0b7937-ac17-4721-94e2-fa690558673a req-c307368e-ff00-4686-8225-4cf45472a34f service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f for instance with vm_state building and task_state spawning.
Aug 17 14:46:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283586.0944214, e9d53810-409d-41d6-bae3-b30937b21b25 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] VM Resumed (Lifecycle Event)
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Instance spawned successfully.
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283586.0965698, e9d53810-409d-41d6-bae3-b30937b21b25 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] VM Started (Lifecycle Event)
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 17 14:46:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:46:26 user nova-compute[73079]: INFO nova.compute.manager [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Took 6.74 seconds to build instance.
Aug 17 14:46:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7ce908e5-81b3-4ed8-aef2-de91cd041c44 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.935s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Starting finish_revert_migration {{(pid=73079) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start _get_guest_xml network_info=[{"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'fa6f474e-95b2-4250-a81f-646cb36901d1', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9d2c4290-ec0a-4dc3-8afa-552487ac923f', 'attached_at': '2023-08-17T14:46:28.000000', 'detached_at': '', 'volume_id': '2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783', 'serial': '2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:46:28 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:46:28 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:46:28 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:46:28 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:46:28 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1f8da-f709-41f6-8f51-f80cd4130651]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:46:28 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[704170ea-5e81-4fc3-916d-7782e05e87b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783] added
Aug 17 14:46:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c4a4c9-0a97-41fc-a00a-a24366038a56]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b71850-b22b-4020-90e4-1499439c89a3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWXhsifn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YWXhsifn" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[45444dfc-4ff0-45b5-8132-191e69f0d089]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YWXhsifn'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31692bd-e59f-4d9a-9ada-7c95141c741a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18076e6-987c-480d-a05d-c3a35a8c655b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:28 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:28 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ea662-752b-4ae1-8cc0-9091a7d916aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]
Aug 17 14:46:28 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.
Aug 17 14:46:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2feada-9348-425f-9c69-5b04e1152916]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaedcf2-ae80-4b45-82ca-ddddbef6d582]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:28 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:28 user nova-compute[73079]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:46:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:28 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:28 user nova-compute[73079]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:46:28 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5baa6a5-dd6a-4aaf-87cd-0e3a7d909ebd]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:46:28 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23366383634666538', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366383634666538', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:44:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:46:29 user nova-compute[73079]:   <uuid>9d2c4290-ec0a-4dc3-8afa-552487ac923f</uuid>
Aug 17 14:46:29 user nova-compute[73079]:   <name>instance-00000003</name>
Aug 17 14:46:29 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:46:29 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:46:29 user nova-compute[73079]:   <metadata>
Aug 17 14:46:29 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:46:29 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:46:29 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherB-server-1550667638</nova:name>
Aug 17 14:46:29 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:46:28</nova:creationTime>
Aug 17 14:46:29 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:46:29 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:46:29 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:46:29 user nova-compute[73079]:       <nova:owner>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:user uuid="58b4647e94614c84a7b0b77de3aa4e03">tempest-ServerActionsTestOtherB-1211659744-project-member</nova:user>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:project uuid="a7fcbaf2803041bc9a038147e2d03356">tempest-ServerActionsTestOtherB-1211659744</nova:project>
Aug 17 14:46:29 user nova-compute[73079]:       </nova:owner>
Aug 17 14:46:29 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:46:29 user nova-compute[73079]:       <nova:ports>
Aug 17 14:46:29 user nova-compute[73079]:         <nova:port uuid="5955a467-f321-452d-812d-4796e5b7d6df">
Aug 17 14:46:29 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:46:29 user nova-compute[73079]:         </nova:port>
Aug 17 14:46:29 user nova-compute[73079]:       </nova:ports>
Aug 17 14:46:29 user nova-compute[73079]:     </nova:instance>
Aug 17 14:46:29 user nova-compute[73079]:   </metadata>
Aug 17 14:46:29 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:46:29 user nova-compute[73079]:     <system>
Aug 17 14:46:29 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:46:29 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:46:29 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:46:29 user nova-compute[73079]:       <entry name="serial">9d2c4290-ec0a-4dc3-8afa-552487ac923f</entry>
Aug 17 14:46:29 user nova-compute[73079]:       <entry name="uuid">9d2c4290-ec0a-4dc3-8afa-552487ac923f</entry>
Aug 17 14:46:29 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:46:29 user nova-compute[73079]:     </system>
Aug 17 14:46:29 user nova-compute[73079]:   </sysinfo>
Aug 17 14:46:29 user nova-compute[73079]:   <os>
Aug 17 14:46:29 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:46:29 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:46:29 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:46:29 user nova-compute[73079]:   </os>
Aug 17 14:46:29 user nova-compute[73079]:   <features>
Aug 17 14:46:29 user nova-compute[73079]:     <acpi/>
Aug 17 14:46:29 user nova-compute[73079]:     <apic/>
Aug 17 14:46:29 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:46:29 user nova-compute[73079]:   </features>
Aug 17 14:46:29 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:46:29 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:46:29 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:46:29 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:46:29 user nova-compute[73079]:   </clock>
Aug 17 14:46:29 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:46:29 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:46:29 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:46:29 user nova-compute[73079]:   </cpu>
Aug 17 14:46:29 user nova-compute[73079]:   <devices>
Aug 17 14:46:29 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:46:29 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:46:29 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk"/>
Aug 17 14:46:29 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:46:29 user nova-compute[73079]:     </disk>
Aug 17 14:46:29 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:46:29 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:46:29 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 14:46:29 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:46:29 user nova-compute[73079]:       <serial>2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783</serial>
Aug 17 14:46:29 user nova-compute[73079]:     </disk>
Aug 17 14:46:29 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:46:29 user nova-compute[73079]:       <mac address="fa:16:3e:34:d7:35"/>
Aug 17 14:46:29 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:46:29 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:46:29 user nova-compute[73079]:       <target dev="tap5955a467-f3"/>
Aug 17 14:46:29 user nova-compute[73079]:     </interface>
Aug 17 14:46:29 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:46:29 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/console.log" append="off"/>
Aug 17 14:46:29 user nova-compute[73079]:     </serial>
Aug 17 14:46:29 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:46:29 user nova-compute[73079]:     <video>
Aug 17 14:46:29 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:46:29 user nova-compute[73079]:     </video>
Aug 17 14:46:29 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:46:29 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:46:29 user nova-compute[73079]:     </rng>
Aug 17 14:46:29 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:46:29 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:46:29 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:46:29 user nova-compute[73079]:     </memballoon>
Aug 17 14:46:29 user nova-compute[73079]:   </devices>
Aug 17 14:46:29 user nova-compute[73079]: </domain>
Aug 17 14:46:29 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:44:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG os_vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5955a467-f3, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5955a467-f3, col_values=(('external_ids', {'iface-id': '5955a467-f321-452d-812d-4796e5b7d6df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:d7:35', 'vm-uuid': '9d2c4290-ec0a-4dc3-8afa-552487ac923f'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:30 user nova-compute[73079]: INFO os_vif [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3')
Aug 17 14:46:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-47ca2368-ac8e-4d9c-be6d-7c808c29af64 req-48e487fd-1e26-4a8c-ba31-de6ef61f5166 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-47ca2368-ac8e-4d9c-be6d-7c808c29af64 req-48e487fd-1e26-4a8c-ba31-de6ef61f5166 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-47ca2368-ac8e-4d9c-be6d-7c808c29af64 req-48e487fd-1e26-4a8c-ba31-de6ef61f5166 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-47ca2368-ac8e-4d9c-be6d-7c808c29af64 req-48e487fd-1e26-4a8c-ba31-de6ef61f5166 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-47ca2368-ac8e-4d9c-be6d-7c808c29af64 req-48e487fd-1e26-4a8c-ba31-de6ef61f5166 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:31 user nova-compute[73079]: WARNING nova.compute.manager [req-47ca2368-ac8e-4d9c-be6d-7c808c29af64 req-48e487fd-1e26-4a8c-ba31-de6ef61f5166 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state resized and task_state resize_reverting.
Aug 17 14:46:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.compute.manager [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Detaching volume e93a3e41-c79e-49fe-995e-8f11b66501d8
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.virt.block_device [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Attempting to driver detach volume e93a3e41-c79e-49fe-995e-8f11b66501d8 from mountpoint /dev/vdb
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Attempting to detach device vdb from instance 02f2d969-22f4-4785-a5e2-c805d45256b3 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:46:33 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:46:33 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:46:33 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:46:33 user nova-compute[73079]:   <serial>e93a3e41-c79e-49fe-995e-8f11b66501d8</serial>
Aug 17 14:46:33 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:46:33 user nova-compute[73079]: </disk>
Aug 17 14:46:33 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Successfully detached device vdb from instance 02f2d969-22f4-4785-a5e2-c805d45256b3 from the persistent domain config.
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02f2d969-22f4-4785-a5e2-c805d45256b3 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:46:33 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:46:33 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:46:33 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:46:33 user nova-compute[73079]:   <serial>e93a3e41-c79e-49fe-995e-8f11b66501d8</serial>
Aug 17 14:46:33 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:46:33 user nova-compute[73079]: </disk>
Aug 17 14:46:33 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283593.6724422, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Resumed (Lifecycle Event)
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance running successfully.
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] finish_revert_migration finished successfully. {{(pid=73079) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-e6264215-2101-44cd-ada3-b5ce91e3a8b1 req-1b62c413-1e2c-4b17-ad4c-f7d4b88cf93d service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e6264215-2101-44cd-ada3-b5ce91e3a8b1 req-1b62c413-1e2c-4b17-ad4c-f7d4b88cf93d service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e6264215-2101-44cd-ada3-b5ce91e3a8b1 req-1b62c413-1e2c-4b17-ad4c-f7d4b88cf93d service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e6264215-2101-44cd-ada3-b5ce91e3a8b1 req-1b62c413-1e2c-4b17-ad4c-f7d4b88cf93d service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-e6264215-2101-44cd-ada3-b5ce91e3a8b1 req-1b62c413-1e2c-4b17-ad4c-f7d4b88cf93d service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:33 user nova-compute[73079]: WARNING nova.compute.manager [req-e6264215-2101-44cd-ada3-b5ce91e3a8b1 req-1b62c413-1e2c-4b17-ad4c-f7d4b88cf93d service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state resized and task_state resize_reverting.
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283593.6734354, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Started (Lifecycle Event)
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283593.7451727, 02f2d969-22f4-4785-a5e2-c805d45256b3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Successfully detached device vdb from instance 02f2d969-22f4-4785-a5e2-c805d45256b3 from the live domain config.
Aug 17 14:46:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDBjbmSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:46:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e73a5c-73ec-472c-a958-07da699fcd4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:33 user nova-compute[73079]: INFO nova.compute.manager [None req-4b8fecbd-2a6b-4bc5-8929-cc9c205244de tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance to original state: 'active'
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d2ad47-0f7a-4db0-a067-dddc9d341ece]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:33 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:33 user nova-compute[73079]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:46:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 (non-flash)
Aug 17 14:46:33 user nova-compute[73079]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:46:33 user nova-compute[73079]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:46:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8257ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2f64a-b801-4ad4-8617-c2e83e6670b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[17480bd0-c86f-4568-a50d-10bf3e56f1d0]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa104b-dd50-4e4e-a227-b88563de16be]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d757fd8-9e5f-497d-a353-ad3be1de4b74]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:46:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bc8104-636f-4ee1-acbc-7e9ee2c0b60f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7cc81d-c1e1-4086-bde7-b7a494a89840]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260]
Aug 17 14:46:34 user nova-compute[73079]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8, portal: 172.16.0.220,3260] successful.
Aug 17 14:46:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93a3e41-c79e-49fe-995e-8f11b66501d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b514c9f-bebf-4ca1-9fd5-00cf66660b68]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] <== disconnect_volume: return (306ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283579.5537953, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:34 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Stopped (Lifecycle Event)
Aug 17 14:46:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9aa18504-e6e9-4658-b86b-3da644d5ed5e None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9aa18504-e6e9-4658-b86b-3da644d5ed5e None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'flavor' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-393ccc17-8ab5-4970-b52a-ca5e3d9d4a52 tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.902s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid a2c17473-d65d-4a2b-8382-ac868705c232 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "a2c17473-d65d-4a2b-8382-ac868705c232" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "a2c17473-d65d-4a2b-8382-ac868705c232" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:40 user nova-compute[73079]: INFO nova.compute.manager [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Terminating instance
Aug 17 14:46:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-968f7455-b09e-4fbd-8e83-fcd481608dab req-1056d814-c0d3-4218-b2b6-2c8910f5004f service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-vif-unplugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-968f7455-b09e-4fbd-8e83-fcd481608dab req-1056d814-c0d3-4218-b2b6-2c8910f5004f service nova] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-968f7455-b09e-4fbd-8e83-fcd481608dab req-1056d814-c0d3-4218-b2b6-2c8910f5004f service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-968f7455-b09e-4fbd-8e83-fcd481608dab req-1056d814-c0d3-4218-b2b6-2c8910f5004f service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-968f7455-b09e-4fbd-8e83-fcd481608dab req-1056d814-c0d3-4218-b2b6-2c8910f5004f service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] No waiting events found dispatching network-vif-unplugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-968f7455-b09e-4fbd-8e83-fcd481608dab req-1056d814-c0d3-4218-b2b6-2c8910f5004f service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-vif-unplugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:46:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Instance destroyed successfully.
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lazy-loading 'resources' on Instance uuid a279bc96-247f-43e4-9d99-3dc690da4d0a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-586977430',display_name='tempest-VolumesAdminNegativeTest-server-586977430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-586977430',id=6,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBn7UzapkwUx5QrPxoGiR89m+1DEW9Ke9qQHGQe9cHwqqaVdJuNIrFRodYtbW6Je3eRNKAs/cSorXZNlPRiCKxesA/HfK0cNTyufqRL5lQXZRzGVr/VNJ9IFvjUud+mMhg==',key_name='tempest-keypair-698818835',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd3cf39349f140cb962abc3857c8b7c0',ramdisk_id='',reservation_id='r-gveqbshp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-385938588',owner_user_name='tempest-VolumesAdminNegativeTest-385938588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0e2a779916a4463a819fa223bb0af42',uuid=a279bc96-247f-43e4-9d99-3dc690da4d0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converting VIF {"id": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "address": "fa:16:3e:62:d3:d3", "network": {"id": "a0cc8e20-649e-47d7-9ec1-25741b5b2449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1099975345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3cf39349f140cb962abc3857c8b7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d49d09-b3", "ovs_interfaceid": "88d49d09-b3cc-4344-afc5-e4055c2c9a8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG os_vif [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88d49d09-b3, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:41 user nova-compute[73079]: INFO os_vif [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:d3:d3,bridge_name='br-int',has_traffic_filtering=True,id=88d49d09-b3cc-4344-afc5-e4055c2c9a8e,network=Network(a0cc8e20-649e-47d7-9ec1-25741b5b2449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d49d09-b3')
Aug 17 14:46:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Deleting instance files /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a_del
Aug 17 14:46:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Deletion of /opt/stack/data/nova/instances/a279bc96-247f-43e4-9d99-3dc690da4d0a_del complete
Aug 17 14:46:41 user nova-compute[73079]: INFO nova.compute.manager [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 14:46:41 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:46:41 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:46:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:46:42 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Took 0.83 seconds to deallocate network for instance.
Aug 17 14:46:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:42 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:46:42 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:46:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:42 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Deleted allocations for instance a279bc96-247f-43e4-9d99-3dc690da4d0a
Aug 17 14:46:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8733f52d-90f6-454b-9e13-7a2bd73beb07 tempest-VolumesAdminNegativeTest-385938588 tempest-VolumesAdminNegativeTest-385938588-project-member] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.301s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] Acquiring lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:46:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:46:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] Lock "a279bc96-247f-43e4-9d99-3dc690da4d0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:46:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] No waiting events found dispatching network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:46:43 user nova-compute[73079]: WARNING nova.compute.manager [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received unexpected event network-vif-plugged-88d49d09-b3cc-4344-afc5-e4055c2c9a8e for instance with vm_state deleted and task_state None.
Aug 17 14:46:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-8fd22103-710c-4f6d-93e3-fdafe20638a3 req-f56e7917-ca40-4c2a-9ba2-b2a6b3f3119c service nova] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Received event network-vif-deleted-88d49d09-b3cc-4344-afc5-e4055c2c9a8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:56 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283601.5996757, a279bc96-247f-43e4-9d99-3dc690da4d0a => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:46:56 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] VM Stopped (Lifecycle Event)
Aug 17 14:46:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cebbdfd4-84dc-44b9-b544-e32e946d83ef None None] [instance: a279bc96-247f-43e4-9d99-3dc690da4d0a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:46:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:46:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-changed-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:46:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Refreshing instance network info cache due to event network-changed-17ae6a67-9f51-487e-b36d-83690838779b. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:46:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] Acquiring lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:46:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] Acquired lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:46:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Refreshing network info cache for port 17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updated VIF entry in instance network info cache for port 17ae6a67-9f51-487e-b36d-83690838779b. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updating instance_info_cache with network_info: [{"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad086d6d-dcdd-4280-a543-47f60dc0fa9b req-67577915-efb9-4b6a-9d80-3f98781664ff service nova] Releasing lock "refresh_cache-07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:47:00 user nova-compute[73079]: INFO nova.compute.manager [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Rebuilding instance
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'trusted_certs' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'pci_requests' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'pci_devices' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'resources' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'migration_context' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73079) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance destroyed successfully.
Aug 17 14:47:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance destroyed successfully.
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-307142343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1807850676',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq9zO9T/lSSvO4QLehADGZzJc7bYUBIPgnANEDieXE5JLP9mBiULljyHZTfMZqXKbWrnnui8Rk/GnLkz4Hv78LmqRtHLA9c24KJAQUpRVAqSLPws1XinirRIeFeYLuQag==',key_name='tempest-keypair-353563461',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:45:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa7065c3e6c348ae929d7a53011117a4',ramdisk_id='',reservation_id='r-0e3y0gw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796114192',owner_user_name='tempest-ServerActionsV293TestJSON-1796114192-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5961828bebbf4a8b9168d8e7f91fe738',uuid=07c1ea4d-000b-4352-8284-5d2b1f1dfaa7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converting VIF {"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17ae6a67-9f, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:01 user nova-compute[73079]: INFO os_vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f')
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:01 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e132bc-e4ef-44c2-a80c-16028a254cb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddb92b0-cb2f-435d-974b-34eab347253e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:47:01 user nova-compute[73079]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:01 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:47:01 user nova-compute[73079]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:01 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f77b27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c9743b-deb0-498e-a0cd-5bf65c7df5b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233d226-df56-4b54-8ed8-aa236b49178c]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-unplugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-unplugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:01 user nova-compute[73079]: WARNING nova.compute.manager [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-unplugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state active and task_state rebuilding.
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:01 user nova-compute[73079]: WARNING nova.compute.manager [req-ff06a1e6-f5db-4a6e-9b97-93643071db1e req-14d1be01-85f0-4ae2-a820-e24e81f6a6f2 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state active and task_state rebuilding.
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.038s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e44f6bf-5019-4a89-a8c0-ddfac306c397]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.131s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee93282-e706-42ad-92da-960ee0e05e73]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e28593-f51c-4d24-a6de-38a12150648a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf8ecec-c82f-434d-9068-ed3c2af8ca89]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]
Aug 17 14:47:01 user nova-compute[73079]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.
Aug 17 14:47:01 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73efe6-5158-4995-8d6b-181929fbdd33]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== disconnect_volume: return (414ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:47:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Deleting instance files /opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7_del
Aug 17 14:47:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Deletion of /opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7_del complete
Aug 17 14:47:01 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 could not be found.
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:01 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4cdb52-e54a-4479-88b1-113a458a0db5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd8c43-7d8e-425b-a4d6-d5c2358acde6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:01 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:01 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e84e65f0>, {}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Disconnecting from: [] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== disconnect_volume: return (46ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:47:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Preparing to wait for external event volume-reimaged-0ae8ed0a-6053-46f5-adeb-f7fee6aca52f {{(pid=73079) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 14:47:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:07 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:47:07 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8008MB free_disk=25.57223892211914GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e9d53810-409d-41d6-bae3-b30937b21b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:47:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:47:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:47:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:47:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:16 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283621.199833, 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:16 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] VM Stopped (Lifecycle Event)
Aug 17 14:47:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e4eed227-65ed-472a-969a-8163af1a6d09 None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:21 user nova-compute[73079]: INFO nova.compute.manager [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Unshelving
Aug 17 14:47:21 user nova-compute[73079]: INFO nova.virt.block_device [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Booting with volume 95d5ab03-90ad-424f-87aa-26517212d148 at /dev/vdc
Aug 17 14:47:21 user nova-compute[73079]: DEBUG os_brick.utils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae05abc-b5ff-4456-8153-7676a9d8c26d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb52513-34e7-4599-8b1a-f553f0df3cdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd1482-5d77-4e7e-a025-a96c0bd8506e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce32dcc8-ee63-4f2c-aa44-dc56f610eed6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:47:21 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:47:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[56638297-3671-4479-bd99-a0fb6d3ec88e]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG os_brick.utils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:21 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating existing volume attachment record: d1012d4e-58c8-470d-bf23-7b87dd0495d4 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:47:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:23 user nova-compute[73079]: INFO nova.compute.manager [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Terminating instance
Aug 17 14:47:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-79780471-21f3-412c-a8d8-1556fa4a0b50 req-d1401d88-400a-42c8-a639-1d4e9e5a2cf0 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event volume-reimaged-0ae8ed0a-6053-46f5-adeb-f7fee6aca52f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-79780471-21f3-412c-a8d8-1556fa4a0b50 req-d1401d88-400a-42c8-a639-1d4e9e5a2cf0 service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-79780471-21f3-412c-a8d8-1556fa4a0b50 req-d1401d88-400a-42c8-a639-1d4e9e5a2cf0 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-79780471-21f3-412c-a8d8-1556fa4a0b50 req-d1401d88-400a-42c8-a639-1d4e9e5a2cf0 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-79780471-21f3-412c-a8d8-1556fa4a0b50 req-d1401d88-400a-42c8-a639-1d4e9e5a2cf0 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Processing event volume-reimaged-0ae8ed0a-6053-46f5-adeb-f7fee6aca52f {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-0dd7719f-574b-4c40-8982-c29a009f71b7 req-3e05dc49-1350-4baa-b5ed-286add3b58ba service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0dd7719f-574b-4c40-8982-c29a009f71b7 req-3e05dc49-1350-4baa-b5ed-286add3b58ba service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0dd7719f-574b-4c40-8982-c29a009f71b7 req-3e05dc49-1350-4baa-b5ed-286add3b58ba service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0dd7719f-574b-4c40-8982-c29a009f71b7 req-3e05dc49-1350-4baa-b5ed-286add3b58ba service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-0dd7719f-574b-4c40-8982-c29a009f71b7 req-3e05dc49-1350-4baa-b5ed-286add3b58ba service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-0dd7719f-574b-4c40-8982-c29a009f71b7 req-3e05dc49-1350-4baa-b5ed-286add3b58ba service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-unplugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:47:24 user nova-compute[73079]: INFO nova.virt.block_device [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Booting with volume 0ae8ed0a-6053-46f5-adeb-f7fee6aca52f at /dev/vda
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_brick.utils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9710293c-91b6-4a42-aa05-eca99194f4cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f671f60-c505-4a83-9421-07ca7a32ac0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce4e9b8-565f-4638-b124-6cffeef70a77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f18866-aac0-4722-ad30-c8752d9ad409]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:47:24 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[968be072-08b1-41cb-9215-2803543cb7fd]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_brick.utils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updating existing volume attachment record: df64c34e-75b0-49d9-b93f-75e4886cc386 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:47:24 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Instance destroyed successfully.
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lazy-loading 'resources' on Instance uuid 02f2d969-22f4-4785-a5e2-c805d45256b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1518138782',display_name='tempest-ServerStableDeviceRescueTest-server-1518138782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1518138782',id=4,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsAjCIc/WwAiAI8Pzwwt/hC03akqhW8QrVflG2svRsETTn8bw3n5V1LOPK7odRcM4K6pl/+pi/eRmipG6h+fDbLKiqHSrOsDumuGA6bSQbmWMlWwULwwhp9wtA9pedt2w==',key_name='tempest-keypair-41245435',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7ba4161b12a4a238ecd22749dff64c4',ramdisk_id='',reservation_id='r-c84flbdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1672943422',owner_user_name='tempest-ServerStableDeviceRescueTest-1672943422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='285ec6eef26e43ef82c9fb559594e1be',uuid=02f2d969-22f4-4785-a5e2-c805d45256b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converting VIF {"id": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "address": "fa:16:3e:c5:62:0d", "network": {"id": "de33eaf5-0b7a-4486-a24a-0b839d858923", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1952364752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7ba4161b12a4a238ecd22749dff64c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc19575ab-df", "ovs_interfaceid": "c19575ab-dfc7-4e70-ac23-4a37a0044152", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG os_vif [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc19575ab-df, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:24 user nova-compute[73079]: INFO os_vif [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:62:0d,bridge_name='br-int',has_traffic_filtering=True,id=c19575ab-dfc7-4e70-ac23-4a37a0044152,network=Network(de33eaf5-0b7a-4486-a24a-0b839d858923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc19575ab-df')
Aug 17 14:47:24 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Deleting instance files /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3_del
Aug 17 14:47:24 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Deletion of /opt/stack/data/nova/instances/02f2d969-22f4-4785-a5e2-c805d45256b3_del complete
Aug 17 14:47:24 user nova-compute[73079]: INFO nova.compute.manager [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 14:47:24 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:47:24 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:25 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Took 0.79 seconds to deallocate network for instance.
Aug 17 14:47:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-a3733673-1642-4a49-9453-bb0a387e7bdf req-f8105cef-12f1-4bbc-8751-5be68a3164c9 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-deleted-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:25 user nova-compute[73079]: INFO nova.compute.manager [req-a3733673-1642-4a49-9453-bb0a387e7bdf req-f8105cef-12f1-4bbc-8751-5be68a3164c9 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Neutron deleted interface c19575ab-dfc7-4e70-ac23-4a37a0044152; detaching it from the instance and deleting it from the info cache
Aug 17 14:47:25 user nova-compute[73079]: DEBUG nova.network.neutron [req-a3733673-1642-4a49-9453-bb0a387e7bdf req-f8105cef-12f1-4bbc-8751-5be68a3164c9 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-a3733673-1642-4a49-9453-bb0a387e7bdf req-f8105cef-12f1-4bbc-8751-5be68a3164c9 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Detach interface failed, port_id=c19575ab-dfc7-4e70-ac23-4a37a0044152, reason: Instance 02f2d969-22f4-4785-a5e2-c805d45256b3 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:47:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:25 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Deleted allocations for instance 02f2d969-22f4-4785-a5e2-c805d45256b3
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c4164d34-3362-4268-905e-b2a38ff5a6db tempest-ServerStableDeviceRescueTest-1672943422 tempest-ServerStableDeviceRescueTest-1672943422-project-member] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-906bfaf9-8116-4eda-956f-f322472181ef req-e95f3247-e906-426a-89f8-4b10e8d13f24 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-906bfaf9-8116-4eda-956f-f322472181ef req-e95f3247-e906-426a-89f8-4b10e8d13f24 service nova] Acquiring lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-906bfaf9-8116-4eda-956f-f322472181ef req-e95f3247-e906-426a-89f8-4b10e8d13f24 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-906bfaf9-8116-4eda-956f-f322472181ef req-e95f3247-e906-426a-89f8-4b10e8d13f24 service nova] Lock "02f2d969-22f4-4785-a5e2-c805d45256b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-906bfaf9-8116-4eda-956f-f322472181ef req-e95f3247-e906-426a-89f8-4b10e8d13f24 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] No waiting events found dispatching network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:26 user nova-compute[73079]: WARNING nova.compute.manager [req-906bfaf9-8116-4eda-956f-f322472181ef req-e95f3247-e906-426a-89f8-4b10e8d13f24 service nova] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Received unexpected event network-vif-plugged-c19575ab-dfc7-4e70-ac23-4a37a0044152 for instance with vm_state deleted and task_state None.
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:47:26 user nova-compute[73079]: INFO nova.compute.claims [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Claim successful on node user
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:47:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:47:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:47:27 user nova-compute[73079]: INFO nova.virt.block_device [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Booting with volume b0d28c05-99d0-4909-883b-11dceff37a41 at /dev/vda
Aug 17 14:47:27 user nova-compute[73079]: DEBUG nova.policy [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd28228aad23b4fceaa2c672075af526c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54af3e289d9e4aa1bc8f1c93716310dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG os_brick.utils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ebcea-1209-4fa3-a9b5-9a607c20e26b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0658f9-759a-4b9c-acba-dc84b0c4cd6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f2500-7b8f-4dae-83ad-740b9e1328ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4776bad8-ae24-4cde-a29a-7af4b683e27d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:47:27 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:47:27 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b47b76-12e5-45db-9225-9faba8dd4a85]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG os_brick.utils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:27 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating existing volume attachment record: 8314b4fd-e10b-4728-ad31-aa5f08403702 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:47:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Successfully created port: 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Successfully updated port: 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.compute.manager [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.compute.manager [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing instance network info cache due to event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance network_info: |[{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG nova.network.neutron [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:47:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updated VIF entry in instance network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:47:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3b3eb363-bf36-4ff4-924f-5f29557733e2 req-8e8690ed-01da-473f-8a4b-7244809f792b service nova] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:47:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'pci_requests' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'numa_topology' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:47:34 user nova-compute[73079]: INFO nova.compute.claims [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Claim successful on node user
Aug 17 14:47:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:47:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:35 user nova-compute[73079]: INFO nova.network.neutron [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating port 38eb71bf-50d8-4510-930a-6060b894242d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG nova.network.neutron [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-changed-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing instance network info cache due to event network-changed-38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:47:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] Acquiring lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:47:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Creating image(s)
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG nova.objects.instance [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'trusted_certs' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] Acquired lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Refreshing network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "592cf0a0e0bcc24ca691db4504ef813ec37e9394" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "592cf0a0e0bcc24ca691db4504ef813ec37e9394" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG nova.virt.images [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] d4c09f01-b2dc-4b86-ac3f-bf40559f698f was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.part /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updated VIF entry in instance network info cache for port 38eb71bf-50d8-4510-930a-6060b894242d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:47:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-89162ec8-4941-439c-bc04-d32b1523cdd6 req-84cff5d0-9632-4bf5-99fe-0dd617918ece service nova] Releasing lock "refresh_cache-dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.part /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.converted" returned: 0 in 0.465s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "592cf0a0e0bcc24ca691db4504ef813ec37e9394" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "592cf0a0e0bcc24ca691db4504ef813ec37e9394" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "592cf0a0e0bcc24ca691db4504ef813ec37e9394" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394,backing_fmt=raw /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394,backing_fmt=raw /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk 1073741824" returned: 0 in 0.122s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "592cf0a0e0bcc24ca691db4504ef813ec37e9394" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:47:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Creating image(s)
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Ensure instance console log exists: /opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Start _get_guest_xml network_info=[{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '8314b4fd-e10b-4728-ad31-aa5f08403702', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c729310-f0a9-4faf-ab22-02c440738a43', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0d28c05-99d0-4909-883b-11dceff37a41', 'serial': 'b0d28c05-99d0-4909-883b-11dceff37a41'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:47:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:47:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:38 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a875498-d37f-4072-a04e-c54703e9446a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:47:38 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f55a20-b275-4265-a58c-c75d7731fdd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41] added
Aug 17 14:47:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG nova.objects.instance [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'migration_context' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Rebasing disk image.
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021fca3-2a75-42b6-bfb0-b900f3ed4920]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5a277c-de65-4ff1-a668-9eec2a93c4e1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReNqmEwT {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReNqmEwT" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b562f-6fa4-4cb2-9896-9ade8d4dde44]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReNqmEwT'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea846c0-443a-457a-bb5d-2c88cdf332c9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c8966-af5b-4d2b-b692-5be6191206b7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 -F raw /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84cead1-5351-4071-b780-2042ea671e4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]
Aug 17 14:47:39 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.
Aug 17 14:47:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4923c842-7a04-45d5-9e34-41b7942d0b5a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82437f2-c1d4-469a-8635-4f24c72b697c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:39 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:39 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a21e04-9f8a-434f-afad-f1471dd72e72]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283644.6636903, 02f2d969-22f4-4785-a5e2-c805d45256b3 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:39 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] VM Stopped (Lifecycle Event)
Aug 17 14:47:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ba4f72ac-27f6-4e94-bbc4-bf1ef6c6ecfe None None] [instance: 02f2d969-22f4-4785-a5e2-c805d45256b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23335623535393037', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335623535393037', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2034968715',display_name='tempest-TestShelveInstance-server-2034968715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2034968715',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbGklE/wIZHfre7/KNRyaOYhfx9Ub85b5BHkSuHI78cUei5tmdmA06ZzGd6VV3OrmVHzGwMAwituwDPQcNVFrxlKVO53+m+KaPpwVtFoir5ymc3bkR/Cqvhak6QwxrdwA==',key_name='tempest-TestShelveInstance-844004364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54af3e289d9e4aa1bc8f1c93716310dd',ramdisk_id='',reservation_id='r-kz120ti7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-341194626',owner_user_name='tempest-TestShelveInstance-341194626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:27Z,user_data=None,user_id='d28228aad23b4fceaa2c672075af526c',uuid=4c729310-f0a9-4faf-ab22-02c440738a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converting VIF {"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:47:40 user nova-compute[73079]:   <uuid>4c729310-f0a9-4faf-ab22-02c440738a43</uuid>
Aug 17 14:47:40 user nova-compute[73079]:   <name>instance-00000010</name>
Aug 17 14:47:40 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:47:40 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:47:40 user nova-compute[73079]:   <metadata>
Aug 17 14:47:40 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:47:40 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:47:40 user nova-compute[73079]:       <nova:name>tempest-TestShelveInstance-server-2034968715</nova:name>
Aug 17 14:47:40 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:47:38</nova:creationTime>
Aug 17 14:47:40 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:47:40 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:47:40 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:47:40 user nova-compute[73079]:       <nova:owner>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:user uuid="d28228aad23b4fceaa2c672075af526c">tempest-TestShelveInstance-341194626-project-member</nova:user>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:project uuid="54af3e289d9e4aa1bc8f1c93716310dd">tempest-TestShelveInstance-341194626</nova:project>
Aug 17 14:47:40 user nova-compute[73079]:       </nova:owner>
Aug 17 14:47:40 user nova-compute[73079]:       <nova:ports>
Aug 17 14:47:40 user nova-compute[73079]:         <nova:port uuid="4569de50-d6e2-4623-8b72-c2f9a25a4279">
Aug 17 14:47:40 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 14:47:40 user nova-compute[73079]:         </nova:port>
Aug 17 14:47:40 user nova-compute[73079]:       </nova:ports>
Aug 17 14:47:40 user nova-compute[73079]:     </nova:instance>
Aug 17 14:47:40 user nova-compute[73079]:   </metadata>
Aug 17 14:47:40 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:47:40 user nova-compute[73079]:     <system>
Aug 17 14:47:40 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:47:40 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:47:40 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:47:40 user nova-compute[73079]:       <entry name="serial">4c729310-f0a9-4faf-ab22-02c440738a43</entry>
Aug 17 14:47:40 user nova-compute[73079]:       <entry name="uuid">4c729310-f0a9-4faf-ab22-02c440738a43</entry>
Aug 17 14:47:40 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:47:40 user nova-compute[73079]:     </system>
Aug 17 14:47:40 user nova-compute[73079]:   </sysinfo>
Aug 17 14:47:40 user nova-compute[73079]:   <os>
Aug 17 14:47:40 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:47:40 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:47:40 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:47:40 user nova-compute[73079]:   </os>
Aug 17 14:47:40 user nova-compute[73079]:   <features>
Aug 17 14:47:40 user nova-compute[73079]:     <acpi/>
Aug 17 14:47:40 user nova-compute[73079]:     <apic/>
Aug 17 14:47:40 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:47:40 user nova-compute[73079]:   </features>
Aug 17 14:47:40 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:47:40 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:47:40 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:47:40 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:47:40 user nova-compute[73079]:   </clock>
Aug 17 14:47:40 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:47:40 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:47:40 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:47:40 user nova-compute[73079]:   </cpu>
Aug 17 14:47:40 user nova-compute[73079]:   <devices>
Aug 17 14:47:40 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:47:40 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:47:40 user nova-compute[73079]:       <source dev="/dev/sdc"/>
Aug 17 14:47:40 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:47:40 user nova-compute[73079]:       <serial>b0d28c05-99d0-4909-883b-11dceff37a41</serial>
Aug 17 14:47:40 user nova-compute[73079]:     </disk>
Aug 17 14:47:40 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:47:40 user nova-compute[73079]:       <mac address="fa:16:3e:e5:ac:71"/>
Aug 17 14:47:40 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:47:40 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:47:40 user nova-compute[73079]:       <target dev="tap4569de50-d6"/>
Aug 17 14:47:40 user nova-compute[73079]:     </interface>
Aug 17 14:47:40 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:47:40 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43/console.log" append="off"/>
Aug 17 14:47:40 user nova-compute[73079]:     </serial>
Aug 17 14:47:40 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:47:40 user nova-compute[73079]:     <video>
Aug 17 14:47:40 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:47:40 user nova-compute[73079]:     </video>
Aug 17 14:47:40 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:47:40 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:47:40 user nova-compute[73079]:     </rng>
Aug 17 14:47:40 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:47:40 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:47:40 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:47:40 user nova-compute[73079]:     </memballoon>
Aug 17 14:47:40 user nova-compute[73079]:   </devices>
Aug 17 14:47:40 user nova-compute[73079]: </domain>
Aug 17 14:47:40 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2034968715',display_name='tempest-TestShelveInstance-server-2034968715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2034968715',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbGklE/wIZHfre7/KNRyaOYhfx9Ub85b5BHkSuHI78cUei5tmdmA06ZzGd6VV3OrmVHzGwMAwituwDPQcNVFrxlKVO53+m+KaPpwVtFoir5ymc3bkR/Cqvhak6QwxrdwA==',key_name='tempest-TestShelveInstance-844004364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54af3e289d9e4aa1bc8f1c93716310dd',ramdisk_id='',reservation_id='r-kz120ti7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-341194626',owner_user_name='tempest-TestShelveInstance-341194626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:27Z,user_data=None,user_id='d28228aad23b4fceaa2c672075af526c',uuid=4c729310-f0a9-4faf-ab22-02c440738a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converting VIF {"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG os_vif [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4569de50-d6, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4569de50-d6, col_values=(('external_ids', {'iface-id': '4569de50-d6e2-4623-8b72-c2f9a25a4279', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:ac:71', 'vm-uuid': '4c729310-f0a9-4faf-ab22-02c440738a43'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:40 user nova-compute[73079]: INFO os_vif [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6')
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:47:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] No VIF found with MAC fa:16:3e:e5:ac:71, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 -F raw /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk" returned: 0 in 2.150s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Ensure instance console log exists: /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Start _get_guest_xml network_info=[{"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cfc8e872e2db1baec8950015b4b23e77',container_format='bare',created_at=2023-08-17T14:45:28Z,direct_url=<?>,disk_format='qcow2',id=d4c09f01-b2dc-4b86-ac3f-bf40559f698f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1662234110-shelved',owner='eb0da7dcf51b4267a38083a278e58ef9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T14:45:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'd1012d4e-58c8-470d-bf23-7b87dd0495d4', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhWbdqyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'dcef5f40-f1b3-4fcb-8875-c8e749fc63c1', 'attached_at': '', 'detached_at': '', 'volume_id': '95d5ab03-90ad-424f-87aa-26517212d148', 'serial': '95d5ab03-90ad-424f-87aa-26517212d148'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:47:41 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:47:41 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cfc8e872e2db1baec8950015b4b23e77',container_format='bare',created_at=2023-08-17T14:45:28Z,direct_url=<?>,disk_format='qcow2',id=d4c09f01-b2dc-4b86-ac3f-bf40559f698f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1662234110-shelved',owner='eb0da7dcf51b4267a38083a278e58ef9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T14:45:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.objects.instance [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'vcpu_model' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhWbdqyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:41 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[87be9a4c-a20c-4396-a229-072646dcbeb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:47:41 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5209af2-e79a-495e-be1b-525a83235639]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148] added
Aug 17 14:47:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d76be-2564-477d-9f7f-4f6b33f750fb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee716a7b-54ad-4b79-b6ee-bda12948589c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhWbdqyL {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhWbdqyL" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[40779936-67df-4f6e-a468-c4017f059401]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhWbdqyL'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc2bcdb-98f3-4172-a0bc-2c55df07a69b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c7544d-9345-4d8c-848b-1efc1788614a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3122933b-0ef4-4097-9b4a-9f468be7f6a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260]
Aug 17 14:47:41 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260] successful.
Aug 17 14:47:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c19b3-eddd-4e6a-80e3-0261aa89eebb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[075e958e-35ac-4c55-a730-f519633469bf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:47:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:47:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Creating image(s)
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Ensure instance console log exists: /opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Start _get_guest_xml network_info=[{"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'df64c34e-75b0-49d9-b93f-75e4886cc386', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07c1ea4d-000b-4352-8284-5d2b1f1dfaa7', 'attached_at': '', 'detached_at': '', 'volume_id': '0ae8ed0a-6053-46f5-adeb-f7fee6aca52f', 'serial': '0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:41 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 14:47:41 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.038s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[855996ab-a6bf-481e-9373-f75fa2c6c67a]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:47:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 14:47:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-706f2072-c979-4576-b496-72c7eb95f616 req-2a7a0d03-9f42-4df9-99de-f62c403d0987 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-706f2072-c979-4576-b496-72c7eb95f616 req-2a7a0d03-9f42-4df9-99de-f62c403d0987 service nova] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-706f2072-c979-4576-b496-72c7eb95f616 req-2a7a0d03-9f42-4df9-99de-f62c403d0987 service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-706f2072-c979-4576-b496-72c7eb95f616 req-2a7a0d03-9f42-4df9-99de-f62c403d0987 service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-706f2072-c979-4576-b496-72c7eb95f616 req-2a7a0d03-9f42-4df9-99de-f62c403d0987 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] No waiting events found dispatching network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:41 user nova-compute[73079]: WARNING nova.compute.manager [req-706f2072-c979-4576-b496-72c7eb95f616 req-2a7a0d03-9f42-4df9-99de-f62c403d0987 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received unexpected event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 for instance with vm_state building and task_state spawning.
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhWbdqyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26438613639323262', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438613639323262', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.914s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:42 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:47:42 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa80c546-460b-44de-9094-a7ff225f64e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:47:42 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfa57c-eb98-4d4a-88d4-36f3753139d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f] added
Aug 17 14:47:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1662234110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1662234110',id=12,image_ref='d4c09f01-b2dc-4b86-ac3f-bf40559f698f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1562296241',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-ufol2uj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member',shelved_at='2023-08-17T14:45:32.701912',shelved_host='user',shelved_image_id='d4c09f01-b2dc-4b86-ac3f-bf40559f698f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=dcef5f40-f1b3-4fcb-8875-c8e749fc63c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'pci_devices' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2348ca41-d61d-45d2-ac8e-6fcb161c87db]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:47:42 user nova-compute[73079]:   <uuid>dcef5f40-f1b3-4fcb-8875-c8e749fc63c1</uuid>
Aug 17 14:47:42 user nova-compute[73079]:   <name>instance-0000000c</name>
Aug 17 14:47:42 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:47:42 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:47:42 user nova-compute[73079]:   <metadata>
Aug 17 14:47:42 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:47:42 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:47:42 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1662234110</nova:name>
Aug 17 14:47:42 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:47:41</nova:creationTime>
Aug 17 14:47:42 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:47:42 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:47:42 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:47:42 user nova-compute[73079]:       <nova:owner>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:user uuid="bb1feccca7d645ac90dff8f481bfe139">tempest-AttachVolumeShelveTestJSON-474259075-project-member</nova:user>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:project uuid="eb0da7dcf51b4267a38083a278e58ef9">tempest-AttachVolumeShelveTestJSON-474259075</nova:project>
Aug 17 14:47:42 user nova-compute[73079]:       </nova:owner>
Aug 17 14:47:42 user nova-compute[73079]:       <nova:root type="image" uuid="d4c09f01-b2dc-4b86-ac3f-bf40559f698f"/>
Aug 17 14:47:42 user nova-compute[73079]:       <nova:ports>
Aug 17 14:47:42 user nova-compute[73079]:         <nova:port uuid="38eb71bf-50d8-4510-930a-6060b894242d">
Aug 17 14:47:42 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 14:47:42 user nova-compute[73079]:         </nova:port>
Aug 17 14:47:42 user nova-compute[73079]:       </nova:ports>
Aug 17 14:47:42 user nova-compute[73079]:     </nova:instance>
Aug 17 14:47:42 user nova-compute[73079]:   </metadata>
Aug 17 14:47:42 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:47:42 user nova-compute[73079]:     <system>
Aug 17 14:47:42 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:47:42 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:47:42 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:47:42 user nova-compute[73079]:       <entry name="serial">dcef5f40-f1b3-4fcb-8875-c8e749fc63c1</entry>
Aug 17 14:47:42 user nova-compute[73079]:       <entry name="uuid">dcef5f40-f1b3-4fcb-8875-c8e749fc63c1</entry>
Aug 17 14:47:42 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:47:42 user nova-compute[73079]:     </system>
Aug 17 14:47:42 user nova-compute[73079]:   </sysinfo>
Aug 17 14:47:42 user nova-compute[73079]:   <os>
Aug 17 14:47:42 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:47:42 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:47:42 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:47:42 user nova-compute[73079]:   </os>
Aug 17 14:47:42 user nova-compute[73079]:   <features>
Aug 17 14:47:42 user nova-compute[73079]:     <acpi/>
Aug 17 14:47:42 user nova-compute[73079]:     <apic/>
Aug 17 14:47:42 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:47:42 user nova-compute[73079]:   </features>
Aug 17 14:47:42 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:47:42 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:47:42 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:47:42 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:47:42 user nova-compute[73079]:   </clock>
Aug 17 14:47:42 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:47:42 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:47:42 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:47:42 user nova-compute[73079]:   </cpu>
Aug 17 14:47:42 user nova-compute[73079]:   <devices>
Aug 17 14:47:42 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:47:42 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:47:42 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk"/>
Aug 17 14:47:42 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:47:42 user nova-compute[73079]:     </disk>
Aug 17 14:47:42 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:47:42 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:47:42 user nova-compute[73079]:       <source dev="/dev/sdd"/>
Aug 17 14:47:42 user nova-compute[73079]:       <target dev="vdc" bus="virtio"/>
Aug 17 14:47:42 user nova-compute[73079]:       <serial>95d5ab03-90ad-424f-87aa-26517212d148</serial>
Aug 17 14:47:42 user nova-compute[73079]:     </disk>
Aug 17 14:47:42 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:47:42 user nova-compute[73079]:       <mac address="fa:16:3e:a2:28:f2"/>
Aug 17 14:47:42 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:47:42 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:47:42 user nova-compute[73079]:       <target dev="tap38eb71bf-50"/>
Aug 17 14:47:42 user nova-compute[73079]:     </interface>
Aug 17 14:47:42 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:47:42 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/console.log" append="off"/>
Aug 17 14:47:42 user nova-compute[73079]:     </serial>
Aug 17 14:47:42 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:47:42 user nova-compute[73079]:     <video>
Aug 17 14:47:42 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:47:42 user nova-compute[73079]:     </video>
Aug 17 14:47:42 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:47:42 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:47:42 user nova-compute[73079]:     </rng>
Aug 17 14:47:42 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:47:42 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:47:42 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:47:42 user nova-compute[73079]:     </memballoon>
Aug 17 14:47:42 user nova-compute[73079]:   </devices>
Aug 17 14:47:42 user nova-compute[73079]: </domain>
Aug 17 14:47:42 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1662234110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1662234110',id=12,image_ref='d4c09f01-b2dc-4b86-ac3f-bf40559f698f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1562296241',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-ufol2uj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member',shelved_at='2023-08-17T14:45:32.701912',shelved_host='user',shelved_image_id='d4c09f01-b2dc-4b86-ac3f-bf40559f698f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=dcef5f40-f1b3-4fcb-8875-c8e749fc63c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_vif [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38eb71bf-50, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38eb71bf-50, col_values=(('external_ids', {'iface-id': '38eb71bf-50d8-4510-930a-6060b894242d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:28:f2', 'vm-uuid': 'dcef5f40-f1b3-4fcb-8875-c8e749fc63c1'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaaf0d8-5134-4634-a9a2-3335b2429abb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTPGKOdv {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:42 user nova-compute[73079]: INFO os_vif [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50')
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTPGKOdv" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[48047a49-62aa-49bb-88a0-aa7d9f9fd44d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTPGKOdv'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3a9138-0288-47f7-a451-e9088f893d8f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0b5224-7232-4134-8dc6-6e360184ed7d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:42 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:42 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:47:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:42 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:42 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:47:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No VIF found with MAC fa:16:3e:a2:28:f2, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[96203efb-c87d-47d0-a641-035dc34367e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]
Aug 17 14:47:42 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.
Aug 17 14:47:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d6a2b-1118-4cbb-8ee4-9bdcfe2f6611]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21112d82-d551-4944-ab3c-0f3cd58d403c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:43 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:43 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:47:43 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:47:43 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:47:43 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:47:43 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:47:43 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:47:43 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.048s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db13f37-e134-4f43-8ac0-2cd50e24609e]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:47:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-516346cc-d958-4da5-b8b5-33d1742142c0 req-3abce399-77ab-46aa-8fa6-e9cf43bd375e service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-516346cc-d958-4da5-b8b5-33d1742142c0 req-3abce399-77ab-46aa-8fa6-e9cf43bd375e service nova] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-516346cc-d958-4da5-b8b5-33d1742142c0 req-3abce399-77ab-46aa-8fa6-e9cf43bd375e service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-516346cc-d958-4da5-b8b5-33d1742142c0 req-3abce399-77ab-46aa-8fa6-e9cf43bd375e service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-516346cc-d958-4da5-b8b5-33d1742142c0 req-3abce399-77ab-46aa-8fa6-e9cf43bd375e service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] No waiting events found dispatching network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:44 user nova-compute[73079]: WARNING nova.compute.manager [req-516346cc-d958-4da5-b8b5-33d1742142c0 req-3abce399-77ab-46aa-8fa6-e9cf43bd375e service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received unexpected event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 for instance with vm_state building and task_state spawning.
Aug 17 14:47:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== connect_volume: return (2336ms) {'type': 'block', 'scsi_wwn': '23838613961343161', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838613961343161', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-307142343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1807850676',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq9zO9T/lSSvO4QLehADGZzJc7bYUBIPgnANEDieXE5JLP9mBiULljyHZTfMZqXKbWrnnui8Rk/GnLkz4Hv78LmqRtHLA9c24KJAQUpRVAqSLPws1XinirRIeFeYLuQag==',key_name='tempest-keypair-353563461',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:45:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa7065c3e6c348ae929d7a53011117a4',ramdisk_id='',reservation_id='r-0e3y0gw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796114192',owner_user_name='tempest-ServerActionsV293TestJSON-1796114192-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5961828bebbf4a8b9168d8e7f91fe738',uuid=07c1ea4d-000b-4352-8284-5d2b1f1dfaa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converting VIF {"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:47:44 user nova-compute[73079]:   <uuid>07c1ea4d-000b-4352-8284-5d2b1f1dfaa7</uuid>
Aug 17 14:47:44 user nova-compute[73079]:   <name>instance-0000000e</name>
Aug 17 14:47:44 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:47:44 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:47:44 user nova-compute[73079]:   <metadata>
Aug 17 14:47:44 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:47:44 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:47:44 user nova-compute[73079]:       <nova:name>tempest-ServerActionsV293TestJSON-server-307142343</nova:name>
Aug 17 14:47:44 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:47:41</nova:creationTime>
Aug 17 14:47:44 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:47:44 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:47:44 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:47:44 user nova-compute[73079]:       <nova:owner>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:user uuid="5961828bebbf4a8b9168d8e7f91fe738">tempest-ServerActionsV293TestJSON-1796114192-project-member</nova:user>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:project uuid="aa7065c3e6c348ae929d7a53011117a4">tempest-ServerActionsV293TestJSON-1796114192</nova:project>
Aug 17 14:47:44 user nova-compute[73079]:       </nova:owner>
Aug 17 14:47:44 user nova-compute[73079]:       <nova:ports>
Aug 17 14:47:44 user nova-compute[73079]:         <nova:port uuid="17ae6a67-9f51-487e-b36d-83690838779b">
Aug 17 14:47:44 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 14:47:44 user nova-compute[73079]:         </nova:port>
Aug 17 14:47:44 user nova-compute[73079]:       </nova:ports>
Aug 17 14:47:44 user nova-compute[73079]:     </nova:instance>
Aug 17 14:47:44 user nova-compute[73079]:   </metadata>
Aug 17 14:47:44 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:47:44 user nova-compute[73079]:     <system>
Aug 17 14:47:44 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:47:44 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:47:44 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:47:44 user nova-compute[73079]:       <entry name="serial">07c1ea4d-000b-4352-8284-5d2b1f1dfaa7</entry>
Aug 17 14:47:44 user nova-compute[73079]:       <entry name="uuid">07c1ea4d-000b-4352-8284-5d2b1f1dfaa7</entry>
Aug 17 14:47:44 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:47:44 user nova-compute[73079]:     </system>
Aug 17 14:47:44 user nova-compute[73079]:   </sysinfo>
Aug 17 14:47:44 user nova-compute[73079]:   <os>
Aug 17 14:47:44 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:47:44 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:47:44 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:47:44 user nova-compute[73079]:   </os>
Aug 17 14:47:44 user nova-compute[73079]:   <features>
Aug 17 14:47:44 user nova-compute[73079]:     <acpi/>
Aug 17 14:47:44 user nova-compute[73079]:     <apic/>
Aug 17 14:47:44 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:47:44 user nova-compute[73079]:   </features>
Aug 17 14:47:44 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:47:44 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:47:44 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:47:44 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:47:44 user nova-compute[73079]:   </clock>
Aug 17 14:47:44 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:47:44 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:47:44 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:47:44 user nova-compute[73079]:   </cpu>
Aug 17 14:47:44 user nova-compute[73079]:   <devices>
Aug 17 14:47:44 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:47:44 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:47:44 user nova-compute[73079]:       <source dev="/dev/sde"/>
Aug 17 14:47:44 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:47:44 user nova-compute[73079]:       <serial>0ae8ed0a-6053-46f5-adeb-f7fee6aca52f</serial>
Aug 17 14:47:44 user nova-compute[73079]:     </disk>
Aug 17 14:47:44 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:47:44 user nova-compute[73079]:       <mac address="fa:16:3e:54:86:6a"/>
Aug 17 14:47:44 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:47:44 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:47:44 user nova-compute[73079]:       <target dev="tap17ae6a67-9f"/>
Aug 17 14:47:44 user nova-compute[73079]:     </interface>
Aug 17 14:47:44 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:47:44 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7/console.log" append="off"/>
Aug 17 14:47:44 user nova-compute[73079]:     </serial>
Aug 17 14:47:44 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:47:44 user nova-compute[73079]:     <video>
Aug 17 14:47:44 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:47:44 user nova-compute[73079]:     </video>
Aug 17 14:47:44 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:47:44 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:47:44 user nova-compute[73079]:     </rng>
Aug 17 14:47:44 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:47:44 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:47:44 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:47:44 user nova-compute[73079]:     </memballoon>
Aug 17 14:47:44 user nova-compute[73079]:   </devices>
Aug 17 14:47:44 user nova-compute[73079]: </domain>
Aug 17 14:47:44 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-307142343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1807850676',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq9zO9T/lSSvO4QLehADGZzJc7bYUBIPgnANEDieXE5JLP9mBiULljyHZTfMZqXKbWrnnui8Rk/GnLkz4Hv78LmqRtHLA9c24KJAQUpRVAqSLPws1XinirRIeFeYLuQag==',key_name='tempest-keypair-353563461',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:45:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa7065c3e6c348ae929d7a53011117a4',ramdisk_id='',reservation_id='r-0e3y0gw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796114192',owner_user_name='tempest-ServerActionsV293TestJSON-1796114192-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5961828bebbf4a8b9168d8e7f91fe738',uuid=07c1ea4d-000b-4352-8284-5d2b1f1dfaa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converting VIF {"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG os_vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17ae6a67-9f, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17ae6a67-9f, col_values=(('external_ids', {'iface-id': '17ae6a67-9f51-487e-b36d-83690838779b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:86:6a', 'vm-uuid': '07c1ea4d-000b-4352-8284-5d2b1f1dfaa7'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: INFO os_vif [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f')
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] No VIF found with MAC fa:16:3e:54:86:6a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283664.3175895, 4c729310-f0a9-4faf-ab22-02c440738a43 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] VM Resumed (Lifecycle Event)
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance spawned successfully.
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283664.3178296, 4c729310-f0a9-4faf-ab22-02c440738a43 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] VM Started (Lifecycle Event)
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 17 14:47:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:44 user nova-compute[73079]: INFO nova.compute.manager [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Took 17.97 seconds to build instance.
Aug 17 14:47:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e0b62957-2c51-4002-996b-aae3b98ac8d0 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.077s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:46 user nova-compute[73079]: WARNING nova.compute.manager [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 14:47:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:46 user nova-compute[73079]: WARNING nova.compute.manager [req-59464389-3346-4697-964e-047d5aabe555 req-4a98111f-7b04-4ffc-9b5a-d0d36f1ae824 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 14:47:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-f25cb6da-ad02-4e5e-bac7-6e28c954d2a2 req-1acac3a4-a863-4837-9aeb-1f274bfe018d service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f25cb6da-ad02-4e5e-bac7-6e28c954d2a2 req-1acac3a4-a863-4837-9aeb-1f274bfe018d service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f25cb6da-ad02-4e5e-bac7-6e28c954d2a2 req-1acac3a4-a863-4837-9aeb-1f274bfe018d service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f25cb6da-ad02-4e5e-bac7-6e28c954d2a2 req-1acac3a4-a863-4837-9aeb-1f274bfe018d service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-f25cb6da-ad02-4e5e-bac7-6e28c954d2a2 req-1acac3a4-a863-4837-9aeb-1f274bfe018d service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:46 user nova-compute[73079]: WARNING nova.compute.manager [req-f25cb6da-ad02-4e5e-bac7-6e28c954d2a2 req-1acac3a4-a863-4837-9aeb-1f274bfe018d service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state active and task_state rebuild_spawning.
Aug 17 14:47:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283668.0540497, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:48 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] VM Resumed (Lifecycle Event)
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:47:48 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance spawned successfully.
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:47:48 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283668.0546598, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:48 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] VM Started (Lifecycle Event)
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:47:48 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-27eb1bcd-104b-47f8-ace2-8fd47e8ecedb tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.870s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-22200070-1bed-41e9-b0cc-aac86075643e req-b098c709-5261-4554-b424-c5f1c3244283 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-22200070-1bed-41e9-b0cc-aac86075643e req-b098c709-5261-4554-b424-c5f1c3244283 service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-22200070-1bed-41e9-b0cc-aac86075643e req-b098c709-5261-4554-b424-c5f1c3244283 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-22200070-1bed-41e9-b0cc-aac86075643e req-b098c709-5261-4554-b424-c5f1c3244283 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-22200070-1bed-41e9-b0cc-aac86075643e req-b098c709-5261-4554-b424-c5f1c3244283 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:47:48 user nova-compute[73079]: WARNING nova.compute.manager [req-22200070-1bed-41e9-b0cc-aac86075643e req-b098c709-5261-4554-b424-c5f1c3244283 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state active and task_state rebuild_spawning.
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283669.0228555, 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:49 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] VM Resumed (Lifecycle Event)
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:47:49 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance spawned successfully.
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:47:49 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283669.0245833, 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:47:49 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] VM Started (Lifecycle Event)
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:49 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73079) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 14:47:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-79780471-21f3-412c-a8d8-1556fa4a0b50 tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:47:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:47:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:48:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:48:06 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid a2c17473-d65d-4a2b-8382-ac868705c232 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updating instance_info_cache with network_info: [{"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-a2c17473-d65d-4a2b-8382-ac868705c232" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:48:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:48:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:48:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.665897369384766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'info_cache' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a2c17473-d65d-4a2b-8382-ac868705c232 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e9d53810-409d-41d6-bae3-b30937b21b25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 4c729310-f0a9-4faf-ab22-02c440738a43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:48:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:48:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance destroyed successfully.
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'resources' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.823s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG os_vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88abdc44-49, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:10 user nova-compute[73079]: INFO os_vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49')
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start _get_guest_xml network_info=[{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'numa_topology' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:10 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:48:10 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'vcpu_model' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'pci_devices' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:48:10 user nova-compute[73079]:   <uuid>259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</uuid>
Aug 17 14:48:10 user nova-compute[73079]:   <name>instance-00000005</name>
Aug 17 14:48:10 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:48:10 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:48:10 user nova-compute[73079]:   <metadata>
Aug 17 14:48:10 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:10 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:48:10 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeTestJSON-server-433840162</nova:name>
Aug 17 14:48:10 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:48:10</nova:creationTime>
Aug 17 14:48:10 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:48:10 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:10 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:48:10 user nova-compute[73079]:       <nova:owner>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:user uuid="e233ac54eb804ff0b6fdbf986a70dfe8">tempest-AttachVolumeTestJSON-831896009-project-member</nova:user>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:project uuid="3052ad0ca90d483284dd52edd3a79fbe">tempest-AttachVolumeTestJSON-831896009</nova:project>
Aug 17 14:48:10 user nova-compute[73079]:       </nova:owner>
Aug 17 14:48:10 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:10 user nova-compute[73079]:       <nova:ports>
Aug 17 14:48:10 user nova-compute[73079]:         <nova:port uuid="88abdc44-4987-4e42-aac5-80b85b07fa9e">
Aug 17 14:48:10 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 14:48:10 user nova-compute[73079]:         </nova:port>
Aug 17 14:48:10 user nova-compute[73079]:       </nova:ports>
Aug 17 14:48:10 user nova-compute[73079]:     </nova:instance>
Aug 17 14:48:10 user nova-compute[73079]:   </metadata>
Aug 17 14:48:10 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:48:10 user nova-compute[73079]:     <system>
Aug 17 14:48:10 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:48:10 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:48:10 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:48:10 user nova-compute[73079]:       <entry name="serial">259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</entry>
Aug 17 14:48:10 user nova-compute[73079]:       <entry name="uuid">259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a</entry>
Aug 17 14:48:10 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:48:10 user nova-compute[73079]:     </system>
Aug 17 14:48:10 user nova-compute[73079]:   </sysinfo>
Aug 17 14:48:10 user nova-compute[73079]:   <os>
Aug 17 14:48:10 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:48:10 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:48:10 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:48:10 user nova-compute[73079]:   </os>
Aug 17 14:48:10 user nova-compute[73079]:   <features>
Aug 17 14:48:10 user nova-compute[73079]:     <acpi/>
Aug 17 14:48:10 user nova-compute[73079]:     <apic/>
Aug 17 14:48:10 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:48:10 user nova-compute[73079]:   </features>
Aug 17 14:48:10 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:48:10 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:48:10 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:48:10 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:48:10 user nova-compute[73079]:   </clock>
Aug 17 14:48:10 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:48:10 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:48:10 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:48:10 user nova-compute[73079]:   </cpu>
Aug 17 14:48:10 user nova-compute[73079]:   <devices>
Aug 17 14:48:10 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:48:10 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:48:10 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk"/>
Aug 17 14:48:10 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:48:10 user nova-compute[73079]:     </disk>
Aug 17 14:48:10 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:48:10 user nova-compute[73079]:       <mac address="fa:16:3e:44:20:b7"/>
Aug 17 14:48:10 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:48:10 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:48:10 user nova-compute[73079]:       <target dev="tap88abdc44-49"/>
Aug 17 14:48:10 user nova-compute[73079]:     </interface>
Aug 17 14:48:10 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:48:10 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/console.log" append="off"/>
Aug 17 14:48:10 user nova-compute[73079]:     </serial>
Aug 17 14:48:10 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:48:10 user nova-compute[73079]:     <video>
Aug 17 14:48:10 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:48:10 user nova-compute[73079]:     </video>
Aug 17 14:48:10 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:48:10 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:48:10 user nova-compute[73079]:     </rng>
Aug 17 14:48:10 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:48:10 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:48:10 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:48:10 user nova-compute[73079]:     </memballoon>
Aug 17 14:48:10 user nova-compute[73079]:   </devices>
Aug 17 14:48:10 user nova-compute[73079]: </domain>
Aug 17 14:48:10 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'trusted_certs' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-changed-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Refreshing instance network info cache due to event network-changed-1ece65d3-f2d3-4e2d-999c-e91c5d08441f. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] Acquiring lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] Acquired lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.network.neutron [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Refreshing network info cache for port 1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.288s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Cannot resize image /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'migration_context' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG os_vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88abdc44-49, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88abdc44-49, col_values=(('external_ids', {'iface-id': '88abdc44-4987-4e42-aac5-80b85b07fa9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:20:b7', 'vm-uuid': '259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:11 user nova-compute[73079]: INFO os_vif [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49')
Aug 17 14:48:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "interface-e9d53810-409d-41d6-bae3-b30937b21b25-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "interface-e9d53810-409d-41d6-bae3-b30937b21b25-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'flavor' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG nova.network.neutron [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updated VIF entry in instance network info cache for port 1ece65d3-f2d3-4e2d-999c-e91c5d08441f. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG nova.network.neutron [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-491e99cd-8162-450e-bb8d-ae6e87ab1496 req-7e26383a-0acb-42c0-b79b-b52fe719604c service nova] Releasing lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'pci_requests' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG nova.network.neutron [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:48:12 user nova-compute[73079]: DEBUG nova.policy [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cea43fd4553b425b85b6eb25a066055d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47957ef1019a4623ac6bf81921f1619d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:48:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-a6c95b42-1eec-42d1-a71b-9eaf53d53af9 req-a62b0fd3-a26a-4288-a41e-ac703592c426 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a6c95b42-1eec-42d1-a71b-9eaf53d53af9 req-a62b0fd3-a26a-4288-a41e-ac703592c426 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a6c95b42-1eec-42d1-a71b-9eaf53d53af9 req-a62b0fd3-a26a-4288-a41e-ac703592c426 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a6c95b42-1eec-42d1-a71b-9eaf53d53af9 req-a62b0fd3-a26a-4288-a41e-ac703592c426 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-a6c95b42-1eec-42d1-a71b-9eaf53d53af9 req-a62b0fd3-a26a-4288-a41e-ac703592c426 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:14 user nova-compute[73079]: WARNING nova.compute.manager [req-a6c95b42-1eec-42d1-a71b-9eaf53d53af9 req-a62b0fd3-a26a-4288-a41e-ac703592c426 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state powering-on.
Aug 17 14:48:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Successfully created port: feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Successfully updated port: feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquired lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-changed-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Refreshing instance network info cache due to event network-changed-feb3491c-9546-421d-9e53-0076237ae7ff. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] Acquiring lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Releasing lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] Acquired lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.neutron [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Refreshing network info cache for port feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG os_vif [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeb3491c-95, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfeb3491c-95, col_values=(('external_ids', {'iface-id': 'feb3491c-9546-421d-9e53-0076237ae7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b5:06', 'vm-uuid': 'e9d53810-409d-41d6-bae3-b30937b21b25'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: INFO os_vif [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95')
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] attach device xml: <interface type="ethernet">
Aug 17 14:48:15 user nova-compute[73079]:   <mac address="fa:16:3e:f5:b5:06"/>
Aug 17 14:48:15 user nova-compute[73079]:   <model type="virtio"/>
Aug 17 14:48:15 user nova-compute[73079]:   <mtu size="1442"/>
Aug 17 14:48:15 user nova-compute[73079]:   <target dev="tapfeb3491c-95"/>
Aug 17 14:48:15 user nova-compute[73079]: </interface>
Aug 17 14:48:15 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-b4c4b9eb-6cff-4e7c-a753-10074800760e req-c40a5a01-4fda-4335-a94a-50b309a31cc9 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b4c4b9eb-6cff-4e7c-a753-10074800760e req-c40a5a01-4fda-4335-a94a-50b309a31cc9 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b4c4b9eb-6cff-4e7c-a753-10074800760e req-c40a5a01-4fda-4335-a94a-50b309a31cc9 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b4c4b9eb-6cff-4e7c-a753-10074800760e req-c40a5a01-4fda-4335-a94a-50b309a31cc9 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-b4c4b9eb-6cff-4e7c-a753-10074800760e req-c40a5a01-4fda-4335-a94a-50b309a31cc9 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:15 user nova-compute[73079]: WARNING nova.compute.manager [req-b4c4b9eb-6cff-4e7c-a753-10074800760e req-c40a5a01-4fda-4335-a94a-50b309a31cc9 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state stopped and task_state powering-on.
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283696.0061023, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:48:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Resumed (Lifecycle Event)
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:48:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance rebooted successfully.
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ba333e4c-10b2-4527-a51c-43e205d7b72c tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:48:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283696.0080004, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:48:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Started (Lifecycle Event)
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No BDM found with device name hda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No VIF found with MAC fa:16:3e:40:bc:c2, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:16 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:16 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:16 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:16</nova:creationTime>
Aug 17 14:48:16 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:16 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:16 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:16 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:16 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:16 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:16 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:16 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:16 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:16 user nova-compute[73079]:     <nova:port uuid="feb3491c-9546-421d-9e53-0076237ae7ff">
Aug 17 14:48:16 user nova-compute[73079]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Aug 17 14:48:16 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:16 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:16 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:16 user nova-compute[73079]:  {{(pid=73079) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-646db8a7-3fb3-4c02-b978-c824fb01673e tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "interface-e9d53810-409d-41d6-bae3-b30937b21b25-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.326s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updated VIF entry in instance network info cache for port feb3491c-9546-421d-9e53-0076237ae7ff. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b8343aa3-1e59-47d0-8e75-1b14fd57dd54 req-0f584224-ecba-498c-9dcf-dd7ca7eff1b7 service nova] Releasing lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'flavor' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:16 user nova-compute[73079]: INFO nova.compute.manager [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Attaching volume 3e750ae7-b973-44a6-bd04-5fb9efa389d9 to /dev/vdb
Aug 17 14:48:17 user nova-compute[73079]: DEBUG os_brick.utils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5960b71-6fba-492d-83ab-731fc1939b1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5eb671-79aa-479a-b3eb-1b1a2192df16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f66cdba-d6a1-4a45-b0bd-6be710fbac9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[581e74a0-89ba-4158-9157-bd8063537271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:17 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba763e-4b92-4025-a54b-19862c0cc53f]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG os_brick.utils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating existing volume attachment record: 3e6dc54d-1b79-49ba-a4c4-10afe880646c {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:17 user nova-compute[73079]: WARNING nova.compute.manager [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff for instance with vm_state active and task_state None.
Aug 17 14:48:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:17 user nova-compute[73079]: WARNING nova.compute.manager [req-3c940884-e634-41b9-b1a7-5d87db6545ae req-bdb0d829-2939-4036-b8a1-dc04f6dc99e9 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff for instance with vm_state active and task_state None.
Aug 17 14:48:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGLZMDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:29 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:48:29 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:48:29 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de2614-54c6-4b53-8e0b-68314cc7dddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:48:29 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c7e8b7-23c0-475f-b67c-96c147fc0cbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9] added
Aug 17 14:48:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a2b5b8-7cb4-4b0a-96b3-83c11835d6da]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec0855-06b7-402e-961c-416b963666f7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGLZMDz {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGLZMDz" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62c5f9-d418-4593-a45f-1d2fe48e84d6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCGLZMDz'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ff7785-c5e2-4e5e-b31b-aa7865605d24]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c76611-2f51-4630-bda6-ea281c120830]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:29 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:29 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:29 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:29 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:29 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:29 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcb2c13-59eb-4982-b372-8deb6323bbff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260]
Aug 17 14:48:29 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260] successful.
Aug 17 14:48:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33deb8d8-b276-4546-83cb-13cb4c4834cd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49d569a-8284-4544-afa6-7ac0afb9c362]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:30 user nova-compute[73079]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 (non-flash)
Aug 17 14:48:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d31a9a-c4a4-4cb2-a9e6-074ea0e81caa]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGLZMDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:48:30 user nova-compute[73079]: INFO nova.compute.claims [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Claim successful on node user
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26538346466616562', 'path': '/dev/sdf'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346466616562', 'path': '/dev/sdf'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'flavor' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:48:31 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:48:31 user nova-compute[73079]:   <source dev="/dev/sdf"/>
Aug 17 14:48:31 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:48:31 user nova-compute[73079]:   <serial>3e750ae7-b973-44a6-bd04-5fb9efa389d9</serial>
Aug 17 14:48:31 user nova-compute[73079]: </disk>
Aug 17 14:48:31 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:31 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:48:31 user nova-compute[73079]: INFO nova.virt.block_device [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Booting with volume 98e3aadd-8b61-4a44-b7a8-7ebcc281313f at /dev/vda
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.utils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No BDM found with device name hda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] No VIF found with MAC fa:16:3e:40:bc:c2, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2fe574-c51c-4625-8f2a-19f10e4b0df2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893a811-04b0-4f4c-8c67-94613341f8ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.policy [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6178e46fa30a4646bf886fbd84aefe7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfe62d7ce38d45b2b8ed21a331aa7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ccde51-f0d9-422d-b1c9-e38e04022a34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[214d6333-b456-40f2-bf12-42c48dadfa71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:31 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c8b149-b33e-4f48-b3d9-45df0853c3db]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG os_brick.utils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating existing volume attachment record: 6520f7bb-e57c-4175-a2e9-706d821a9e17 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:48:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2583bafd-4448-4167-ac3b-9dbd49446fa4 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.791s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully created port: 8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:32 user nova-compute[73079]: INFO nova.compute.manager [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Detaching volume 3e750ae7-b973-44a6-bd04-5fb9efa389d9
Aug 17 14:48:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully created port: 38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:32 user nova-compute[73079]: INFO nova.virt.block_device [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Attempting to driver detach volume 3e750ae7-b973-44a6-bd04-5fb9efa389d9 from mountpoint /dev/vdb
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Attempting to detach device vdb from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:48:33 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:48:33 user nova-compute[73079]:   <source dev="/dev/sdf"/>
Aug 17 14:48:33 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:48:33 user nova-compute[73079]:   <serial>3e750ae7-b973-44a6-bd04-5fb9efa389d9</serial>
Aug 17 14:48:33 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 14:48:33 user nova-compute[73079]: </disk>
Aug 17 14:48:33 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:48:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully detached device vdb from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the persistent domain config.
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:48:33 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:48:33 user nova-compute[73079]:   <source dev="/dev/sdf"/>
Aug 17 14:48:33 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:48:33 user nova-compute[73079]:   <serial>3e750ae7-b973-44a6-bd04-5fb9efa389d9</serial>
Aug 17 14:48:33 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 14:48:33 user nova-compute[73079]: </disk>
Aug 17 14:48:33 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283713.4516418, e9d53810-409d-41d6-bae3-b30937b21b25 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:48:33 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully detached device vdb from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the live domain config.
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGLZMDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2cbdac-45e5-4a73-bf87-0becfcaaab17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b042697-75fd-442d-bdbd-a2dccb8488dc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:33 user nova-compute[73079]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 (non-flash)
Aug 17 14:48:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f77b0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9'): ({'sdf'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Removing single pathed devices sdf {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e327321-b660-491a-9e19-aff6845830a2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully created port: e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7bda62-bf2e-47dd-aa4f-7994f608494b]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Flushing IO for device /dev/sdf {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9464eef7-743a-4019-bf6c-858e725b2364]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889dcf8-cf75-4e02-9cdc-7101d77a5b65]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] SCSI volumes sdf have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3357af50-831a-4db5-9e9f-9988346a6f99]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad28e843-c5ed-4202-b20d-c96388e74449]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260]
Aug 17 14:48:33 user nova-compute[73079]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9, portal: 172.16.0.220,3260] successful.
Aug 17 14:48:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e750ae7-b973-44a6-bd04-5fb9efa389d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[715d06ab-8704-41eb-9a79-aa9cd31e3dd8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] <== disconnect_volume: return (295ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:48:34 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully created port: 6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'flavor' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d2ec70ea-451b-45d1-986a-a3fab482a4d7 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully created port: 6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "interface-e9d53810-409d-41d6-bae3-b30937b21b25-feb3491c-9546-421d-9e53-0076237ae7ff" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "interface-e9d53810-409d-41d6-bae3-b30937b21b25-feb3491c-9546-421d-9e53-0076237ae7ff" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.004s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.objects.instance [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'flavor' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface> {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface> {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Attempting to detach device tapfeb3491c-95 from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] detach device xml: <interface type="ethernet">
Aug 17 14:48:35 user nova-compute[73079]:   <mac address="fa:16:3e:f5:b5:06"/>
Aug 17 14:48:35 user nova-compute[73079]:   <model type="virtio"/>
Aug 17 14:48:35 user nova-compute[73079]:   <mtu size="1442"/>
Aug 17 14:48:35 user nova-compute[73079]:   <target dev="tapfeb3491c-95"/>
Aug 17 14:48:35 user nova-compute[73079]: </interface>
Aug 17 14:48:35 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface> {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 14:48:35 user nova-compute[73079]:   <name>instance-0000000f</name>
Aug 17 14:48:35 user nova-compute[73079]:   <uuid>e9d53810-409d-41d6-bae3-b30937b21b25</uuid>
Aug 17 14:48:35 user nova-compute[73079]:   <metadata>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:35 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:16</nova:creationTime>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:35 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:35 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:35 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:port uuid="feb3491c-9546-421d-9e53-0076237ae7ff">
Aug 17 14:48:35 user nova-compute[73079]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Aug 17 14:48:35 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:35 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:35 user nova-compute[73079]:   </metadata>
Aug 17 14:48:35 user nova-compute[73079]:   <memory unit='KiB'>524288</memory>
Aug 17 14:48:35 user nova-compute[73079]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 14:48:35 user nova-compute[73079]:   <vcpu placement='static'>1</vcpu>
Aug 17 14:48:35 user nova-compute[73079]:   <resource>
Aug 17 14:48:35 user nova-compute[73079]:     <partition>/machine</partition>
Aug 17 14:48:35 user nova-compute[73079]:   </resource>
Aug 17 14:48:35 user nova-compute[73079]:   <sysinfo type='smbios'>
Aug 17 14:48:35 user nova-compute[73079]:     <system>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='version'>0.0.0</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='serial'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='uuid'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='family'>Virtual Machine</entry>
Aug 17 14:48:35 user nova-compute[73079]:     </system>
Aug 17 14:48:35 user nova-compute[73079]:   </sysinfo>
Aug 17 14:48:35 user nova-compute[73079]:   <os>
Aug 17 14:48:35 user nova-compute[73079]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 14:48:35 user nova-compute[73079]:     <boot dev='hd'/>
Aug 17 14:48:35 user nova-compute[73079]:     <smbios mode='sysinfo'/>
Aug 17 14:48:35 user nova-compute[73079]:   </os>
Aug 17 14:48:35 user nova-compute[73079]:   <features>
Aug 17 14:48:35 user nova-compute[73079]:     <acpi/>
Aug 17 14:48:35 user nova-compute[73079]:     <apic/>
Aug 17 14:48:35 user nova-compute[73079]:     <vmcoreinfo state='on'/>
Aug 17 14:48:35 user nova-compute[73079]:   </features>
Aug 17 14:48:35 user nova-compute[73079]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 14:48:35 user nova-compute[73079]:     <model fallback='forbid'>Nehalem</model>
Aug 17 14:48:35 user nova-compute[73079]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 14:48:35 user nova-compute[73079]:     <feature policy='require' name='vme'/>
Aug 17 14:48:35 user nova-compute[73079]:     <feature policy='require' name='x2apic'/>
Aug 17 14:48:35 user nova-compute[73079]:     <feature policy='require' name='hypervisor'/>
Aug 17 14:48:35 user nova-compute[73079]:   </cpu>
Aug 17 14:48:35 user nova-compute[73079]:   <clock offset='utc'>
Aug 17 14:48:35 user nova-compute[73079]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 14:48:35 user nova-compute[73079]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 14:48:35 user nova-compute[73079]:     <timer name='hpet' present='no'/>
Aug 17 14:48:35 user nova-compute[73079]:   </clock>
Aug 17 14:48:35 user nova-compute[73079]:   <on_poweroff>destroy</on_poweroff>
Aug 17 14:48:35 user nova-compute[73079]:   <on_reboot>restart</on_reboot>
Aug 17 14:48:35 user nova-compute[73079]:   <on_crash>destroy</on_crash>
Aug 17 14:48:35 user nova-compute[73079]:   <devices>
Aug 17 14:48:35 user nova-compute[73079]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 14:48:35 user nova-compute[73079]:     <disk type='file' device='disk'>
Aug 17 14:48:35 user nova-compute[73079]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 14:48:35 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk' index='2'/>
Aug 17 14:48:35 user nova-compute[73079]:       <backingStore type='file' index='3'>
Aug 17 14:48:35 user nova-compute[73079]:         <format type='raw'/>
Aug 17 14:48:35 user nova-compute[73079]:         <source file='/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98'/>
Aug 17 14:48:35 user nova-compute[73079]:         <backingStore/>
Aug 17 14:48:35 user nova-compute[73079]:       </backingStore>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='vda' bus='virtio'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='virtio-disk0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </disk>
Aug 17 14:48:35 user nova-compute[73079]:     <disk type='file' device='cdrom'>
Aug 17 14:48:35 user nova-compute[73079]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 14:48:35 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config' index='1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <backingStore/>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='hda' bus='ide'/>
Aug 17 14:48:35 user nova-compute[73079]:       <readonly/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='ide0-0-0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </disk>
Aug 17 14:48:35 user nova-compute[73079]:     <controller type='usb' index='0' model='none'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='usb'/>
Aug 17 14:48:35 user nova-compute[73079]:     </controller>
Aug 17 14:48:35 user nova-compute[73079]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='pci.0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </controller>
Aug 17 14:48:35 user nova-compute[73079]:     <controller type='ide' index='0'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='ide'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 14:48:35 user nova-compute[73079]:     </controller>
Aug 17 14:48:35 user nova-compute[73079]:     <interface type='ethernet'>
Aug 17 14:48:35 user nova-compute[73079]:       <mac address='fa:16:3e:40:bc:c2'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='tap1ece65d3-f2'/>
Aug 17 14:48:35 user nova-compute[73079]:       <model type='virtio'/>
Aug 17 14:48:35 user nova-compute[73079]:       <mtu size='1442'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='net0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </interface>
Aug 17 14:48:35 user nova-compute[73079]:     <interface type='ethernet'>
Aug 17 14:48:35 user nova-compute[73079]:       <mac address='fa:16:3e:f5:b5:06'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='tapfeb3491c-95'/>
Aug 17 14:48:35 user nova-compute[73079]:       <model type='virtio'/>
Aug 17 14:48:35 user nova-compute[73079]:       <mtu size='1442'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='net1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </interface>
Aug 17 14:48:35 user nova-compute[73079]:     <serial type='pty'>
Aug 17 14:48:35 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target type='isa-serial' port='0'>
Aug 17 14:48:35 user nova-compute[73079]:         <model name='isa-serial'/>
Aug 17 14:48:35 user nova-compute[73079]:       </target>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </serial>
Aug 17 14:48:35 user nova-compute[73079]:     <console type='pty' tty='/dev/pts/1'>
Aug 17 14:48:35 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target type='serial' port='0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </console>
Aug 17 14:48:35 user nova-compute[73079]:     <input type='mouse' bus='ps2'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='input0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </input>
Aug 17 14:48:35 user nova-compute[73079]:     <input type='keyboard' bus='ps2'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='input1'/>
Aug 17 14:48:35 user nova-compute[73079]:     </input>
Aug 17 14:48:35 user nova-compute[73079]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 17 14:48:35 user nova-compute[73079]:       <listen type='address' address='0.0.0.0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </graphics>
Aug 17 14:48:35 user nova-compute[73079]:     <audio id='1' type='none'/>
Aug 17 14:48:35 user nova-compute[73079]:     <video>
Aug 17 14:48:35 user nova-compute[73079]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='video0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </video>
Aug 17 14:48:35 user nova-compute[73079]:     <memballoon model='virtio'>
Aug 17 14:48:35 user nova-compute[73079]:       <stats period='10'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='balloon0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </memballoon>
Aug 17 14:48:35 user nova-compute[73079]:     <rng model='virtio'>
Aug 17 14:48:35 user nova-compute[73079]:       <backend model='random'>/dev/urandom</backend>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='rng0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </rng>
Aug 17 14:48:35 user nova-compute[73079]:   </devices>
Aug 17 14:48:35 user nova-compute[73079]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 14:48:35 user nova-compute[73079]:     <label>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</label>
Aug 17 14:48:35 user nova-compute[73079]:     <imagelabel>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</imagelabel>
Aug 17 14:48:35 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:35 user nova-compute[73079]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 14:48:35 user nova-compute[73079]:     <label>+64055:+108</label>
Aug 17 14:48:35 user nova-compute[73079]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 14:48:35 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:35 user nova-compute[73079]: </domain>
Aug 17 14:48:35 user nova-compute[73079]:  {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 14:48:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully detached device tapfeb3491c-95 from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the persistent domain config.
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] (1/8): Attempting to detach device tapfeb3491c-95 with device alias net1 from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] detach device xml: <interface type="ethernet">
Aug 17 14:48:35 user nova-compute[73079]:   <mac address="fa:16:3e:f5:b5:06"/>
Aug 17 14:48:35 user nova-compute[73079]:   <model type="virtio"/>
Aug 17 14:48:35 user nova-compute[73079]:   <mtu size="1442"/>
Aug 17 14:48:35 user nova-compute[73079]:   <target dev="tapfeb3491c-95"/>
Aug 17 14:48:35 user nova-compute[73079]: </interface>
Aug 17 14:48:35 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283715.5506625, e9d53810-409d-41d6-bae3-b30937b21b25 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Start waiting for the detach event from libvirt for device tapfeb3491c-95 with device alias net1 for instance e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface> {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 14:48:35 user nova-compute[73079]:   <name>instance-0000000f</name>
Aug 17 14:48:35 user nova-compute[73079]:   <uuid>e9d53810-409d-41d6-bae3-b30937b21b25</uuid>
Aug 17 14:48:35 user nova-compute[73079]:   <metadata>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:35 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:16</nova:creationTime>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:35 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:35 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:35 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:port uuid="feb3491c-9546-421d-9e53-0076237ae7ff">
Aug 17 14:48:35 user nova-compute[73079]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Aug 17 14:48:35 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:35 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:35 user nova-compute[73079]:   </metadata>
Aug 17 14:48:35 user nova-compute[73079]:   <memory unit='KiB'>524288</memory>
Aug 17 14:48:35 user nova-compute[73079]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 14:48:35 user nova-compute[73079]:   <vcpu placement='static'>1</vcpu>
Aug 17 14:48:35 user nova-compute[73079]:   <resource>
Aug 17 14:48:35 user nova-compute[73079]:     <partition>/machine</partition>
Aug 17 14:48:35 user nova-compute[73079]:   </resource>
Aug 17 14:48:35 user nova-compute[73079]:   <sysinfo type='smbios'>
Aug 17 14:48:35 user nova-compute[73079]:     <system>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='version'>0.0.0</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='serial'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='uuid'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:35 user nova-compute[73079]:       <entry name='family'>Virtual Machine</entry>
Aug 17 14:48:35 user nova-compute[73079]:     </system>
Aug 17 14:48:35 user nova-compute[73079]:   </sysinfo>
Aug 17 14:48:35 user nova-compute[73079]:   <os>
Aug 17 14:48:35 user nova-compute[73079]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 14:48:35 user nova-compute[73079]:     <boot dev='hd'/>
Aug 17 14:48:35 user nova-compute[73079]:     <smbios mode='sysinfo'/>
Aug 17 14:48:35 user nova-compute[73079]:   </os>
Aug 17 14:48:35 user nova-compute[73079]:   <features>
Aug 17 14:48:35 user nova-compute[73079]:     <acpi/>
Aug 17 14:48:35 user nova-compute[73079]:     <apic/>
Aug 17 14:48:35 user nova-compute[73079]:     <vmcoreinfo state='on'/>
Aug 17 14:48:35 user nova-compute[73079]:   </features>
Aug 17 14:48:35 user nova-compute[73079]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 14:48:35 user nova-compute[73079]:     <model fallback='forbid'>Nehalem</model>
Aug 17 14:48:35 user nova-compute[73079]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 14:48:35 user nova-compute[73079]:     <feature policy='require' name='vme'/>
Aug 17 14:48:35 user nova-compute[73079]:     <feature policy='require' name='x2apic'/>
Aug 17 14:48:35 user nova-compute[73079]:     <feature policy='require' name='hypervisor'/>
Aug 17 14:48:35 user nova-compute[73079]:   </cpu>
Aug 17 14:48:35 user nova-compute[73079]:   <clock offset='utc'>
Aug 17 14:48:35 user nova-compute[73079]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 14:48:35 user nova-compute[73079]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 14:48:35 user nova-compute[73079]:     <timer name='hpet' present='no'/>
Aug 17 14:48:35 user nova-compute[73079]:   </clock>
Aug 17 14:48:35 user nova-compute[73079]:   <on_poweroff>destroy</on_poweroff>
Aug 17 14:48:35 user nova-compute[73079]:   <on_reboot>restart</on_reboot>
Aug 17 14:48:35 user nova-compute[73079]:   <on_crash>destroy</on_crash>
Aug 17 14:48:35 user nova-compute[73079]:   <devices>
Aug 17 14:48:35 user nova-compute[73079]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 14:48:35 user nova-compute[73079]:     <disk type='file' device='disk'>
Aug 17 14:48:35 user nova-compute[73079]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 14:48:35 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk' index='2'/>
Aug 17 14:48:35 user nova-compute[73079]:       <backingStore type='file' index='3'>
Aug 17 14:48:35 user nova-compute[73079]:         <format type='raw'/>
Aug 17 14:48:35 user nova-compute[73079]:         <source file='/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98'/>
Aug 17 14:48:35 user nova-compute[73079]:         <backingStore/>
Aug 17 14:48:35 user nova-compute[73079]:       </backingStore>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='vda' bus='virtio'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='virtio-disk0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </disk>
Aug 17 14:48:35 user nova-compute[73079]:     <disk type='file' device='cdrom'>
Aug 17 14:48:35 user nova-compute[73079]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 14:48:35 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config' index='1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <backingStore/>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='hda' bus='ide'/>
Aug 17 14:48:35 user nova-compute[73079]:       <readonly/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='ide0-0-0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </disk>
Aug 17 14:48:35 user nova-compute[73079]:     <controller type='usb' index='0' model='none'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='usb'/>
Aug 17 14:48:35 user nova-compute[73079]:     </controller>
Aug 17 14:48:35 user nova-compute[73079]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='pci.0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </controller>
Aug 17 14:48:35 user nova-compute[73079]:     <controller type='ide' index='0'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='ide'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 14:48:35 user nova-compute[73079]:     </controller>
Aug 17 14:48:35 user nova-compute[73079]:     <interface type='ethernet'>
Aug 17 14:48:35 user nova-compute[73079]:       <mac address='fa:16:3e:40:bc:c2'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target dev='tap1ece65d3-f2'/>
Aug 17 14:48:35 user nova-compute[73079]:       <model type='virtio'/>
Aug 17 14:48:35 user nova-compute[73079]:       <mtu size='1442'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='net0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </interface>
Aug 17 14:48:35 user nova-compute[73079]:     <serial type='pty'>
Aug 17 14:48:35 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target type='isa-serial' port='0'>
Aug 17 14:48:35 user nova-compute[73079]:         <model name='isa-serial'/>
Aug 17 14:48:35 user nova-compute[73079]:       </target>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </serial>
Aug 17 14:48:35 user nova-compute[73079]:     <console type='pty' tty='/dev/pts/1'>
Aug 17 14:48:35 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:35 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:35 user nova-compute[73079]:       <target type='serial' port='0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </console>
Aug 17 14:48:35 user nova-compute[73079]:     <input type='mouse' bus='ps2'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='input0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </input>
Aug 17 14:48:35 user nova-compute[73079]:     <input type='keyboard' bus='ps2'>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='input1'/>
Aug 17 14:48:35 user nova-compute[73079]:     </input>
Aug 17 14:48:35 user nova-compute[73079]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 17 14:48:35 user nova-compute[73079]:       <listen type='address' address='0.0.0.0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </graphics>
Aug 17 14:48:35 user nova-compute[73079]:     <audio id='1' type='none'/>
Aug 17 14:48:35 user nova-compute[73079]:     <video>
Aug 17 14:48:35 user nova-compute[73079]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='video0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </video>
Aug 17 14:48:35 user nova-compute[73079]:     <memballoon model='virtio'>
Aug 17 14:48:35 user nova-compute[73079]:       <stats period='10'/>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='balloon0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </memballoon>
Aug 17 14:48:35 user nova-compute[73079]:     <rng model='virtio'>
Aug 17 14:48:35 user nova-compute[73079]:       <backend model='random'>/dev/urandom</backend>
Aug 17 14:48:35 user nova-compute[73079]:       <alias name='rng0'/>
Aug 17 14:48:35 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 14:48:35 user nova-compute[73079]:     </rng>
Aug 17 14:48:35 user nova-compute[73079]:   </devices>
Aug 17 14:48:35 user nova-compute[73079]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 14:48:35 user nova-compute[73079]:     <label>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</label>
Aug 17 14:48:35 user nova-compute[73079]:     <imagelabel>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</imagelabel>
Aug 17 14:48:35 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:35 user nova-compute[73079]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 14:48:35 user nova-compute[73079]:     <label>+64055:+108</label>
Aug 17 14:48:35 user nova-compute[73079]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 14:48:35 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:35 user nova-compute[73079]: </domain>
Aug 17 14:48:35 user nova-compute[73079]:  {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 14:48:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully detached device tapfeb3491c-95 from instance e9d53810-409d-41d6-bae3-b30937b21b25 from the live domain config.
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG os_vif [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeb3491c-95, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:35 user nova-compute[73079]: INFO os_vif [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95')
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:35 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:35</nova:creationTime>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:35 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:35 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:35 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:35 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:35 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:35 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:35 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:35 user nova-compute[73079]:  {{(pid=73079) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-f5b1cc2f-32b9-4fc7-a22d-16c58e5b45a2 req-fb8fc00b-58e3-4966-93ed-8829b7bc1caa service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-unplugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f5b1cc2f-32b9-4fc7-a22d-16c58e5b45a2 req-fb8fc00b-58e3-4966-93ed-8829b7bc1caa service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f5b1cc2f-32b9-4fc7-a22d-16c58e5b45a2 req-fb8fc00b-58e3-4966-93ed-8829b7bc1caa service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f5b1cc2f-32b9-4fc7-a22d-16c58e5b45a2 req-fb8fc00b-58e3-4966-93ed-8829b7bc1caa service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-f5b1cc2f-32b9-4fc7-a22d-16c58e5b45a2 req-fb8fc00b-58e3-4966-93ed-8829b7bc1caa service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-unplugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:35 user nova-compute[73079]: WARNING nova.compute.manager [req-f5b1cc2f-32b9-4fc7-a22d-16c58e5b45a2 req-fb8fc00b-58e3-4966-93ed-8829b7bc1caa service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-unplugged-feb3491c-9546-421d-9e53-0076237ae7ff for instance with vm_state active and task_state None.
Aug 17 14:48:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: 8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-8e7ad6a3-fd35-44cd-8295-912e199b872c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port 8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-deleted-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:36 user nova-compute[73079]: INFO nova.compute.manager [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Neutron deleted interface feb3491c-9546-421d-9e53-0076237ae7ff; detaching it from the instance and deleting it from the info cache
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquired lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.objects.instance [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Lazy-loading 'system_metadata' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.objects.instance [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Lazy-loading 'flavor' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.os_vif_util [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Converting VIF {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.os_vif_util [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface> {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 14:48:36 user nova-compute[73079]:   <name>instance-0000000f</name>
Aug 17 14:48:36 user nova-compute[73079]:   <uuid>e9d53810-409d-41d6-bae3-b30937b21b25</uuid>
Aug 17 14:48:36 user nova-compute[73079]:   <metadata>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:36 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:35</nova:creationTime>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:36 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:36 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:36 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:36 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:36 user nova-compute[73079]:   </metadata>
Aug 17 14:48:36 user nova-compute[73079]:   <memory unit='KiB'>524288</memory>
Aug 17 14:48:36 user nova-compute[73079]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 14:48:36 user nova-compute[73079]:   <vcpu placement='static'>1</vcpu>
Aug 17 14:48:36 user nova-compute[73079]:   <resource>
Aug 17 14:48:36 user nova-compute[73079]:     <partition>/machine</partition>
Aug 17 14:48:36 user nova-compute[73079]:   </resource>
Aug 17 14:48:36 user nova-compute[73079]:   <sysinfo type='smbios'>
Aug 17 14:48:36 user nova-compute[73079]:     <system>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='version'>0.0.0</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='serial'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='uuid'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='family'>Virtual Machine</entry>
Aug 17 14:48:36 user nova-compute[73079]:     </system>
Aug 17 14:48:36 user nova-compute[73079]:   </sysinfo>
Aug 17 14:48:36 user nova-compute[73079]:   <os>
Aug 17 14:48:36 user nova-compute[73079]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 14:48:36 user nova-compute[73079]:     <boot dev='hd'/>
Aug 17 14:48:36 user nova-compute[73079]:     <smbios mode='sysinfo'/>
Aug 17 14:48:36 user nova-compute[73079]:   </os>
Aug 17 14:48:36 user nova-compute[73079]:   <features>
Aug 17 14:48:36 user nova-compute[73079]:     <acpi/>
Aug 17 14:48:36 user nova-compute[73079]:     <apic/>
Aug 17 14:48:36 user nova-compute[73079]:     <vmcoreinfo state='on'/>
Aug 17 14:48:36 user nova-compute[73079]:   </features>
Aug 17 14:48:36 user nova-compute[73079]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 14:48:36 user nova-compute[73079]:     <model fallback='forbid'>Nehalem</model>
Aug 17 14:48:36 user nova-compute[73079]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 14:48:36 user nova-compute[73079]:     <feature policy='require' name='vme'/>
Aug 17 14:48:36 user nova-compute[73079]:     <feature policy='require' name='x2apic'/>
Aug 17 14:48:36 user nova-compute[73079]:     <feature policy='require' name='hypervisor'/>
Aug 17 14:48:36 user nova-compute[73079]:   </cpu>
Aug 17 14:48:36 user nova-compute[73079]:   <clock offset='utc'>
Aug 17 14:48:36 user nova-compute[73079]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 14:48:36 user nova-compute[73079]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 14:48:36 user nova-compute[73079]:     <timer name='hpet' present='no'/>
Aug 17 14:48:36 user nova-compute[73079]:   </clock>
Aug 17 14:48:36 user nova-compute[73079]:   <on_poweroff>destroy</on_poweroff>
Aug 17 14:48:36 user nova-compute[73079]:   <on_reboot>restart</on_reboot>
Aug 17 14:48:36 user nova-compute[73079]:   <on_crash>destroy</on_crash>
Aug 17 14:48:36 user nova-compute[73079]:   <devices>
Aug 17 14:48:36 user nova-compute[73079]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 14:48:36 user nova-compute[73079]:     <disk type='file' device='disk'>
Aug 17 14:48:36 user nova-compute[73079]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 14:48:36 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk' index='2'/>
Aug 17 14:48:36 user nova-compute[73079]:       <backingStore type='file' index='3'>
Aug 17 14:48:36 user nova-compute[73079]:         <format type='raw'/>
Aug 17 14:48:36 user nova-compute[73079]:         <source file='/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98'/>
Aug 17 14:48:36 user nova-compute[73079]:         <backingStore/>
Aug 17 14:48:36 user nova-compute[73079]:       </backingStore>
Aug 17 14:48:36 user nova-compute[73079]:       <target dev='vda' bus='virtio'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='virtio-disk0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </disk>
Aug 17 14:48:36 user nova-compute[73079]:     <disk type='file' device='cdrom'>
Aug 17 14:48:36 user nova-compute[73079]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 14:48:36 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config' index='1'/>
Aug 17 14:48:36 user nova-compute[73079]:       <backingStore/>
Aug 17 14:48:36 user nova-compute[73079]:       <target dev='hda' bus='ide'/>
Aug 17 14:48:36 user nova-compute[73079]:       <readonly/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='ide0-0-0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </disk>
Aug 17 14:48:36 user nova-compute[73079]:     <controller type='usb' index='0' model='none'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='usb'/>
Aug 17 14:48:36 user nova-compute[73079]:     </controller>
Aug 17 14:48:36 user nova-compute[73079]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='pci.0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </controller>
Aug 17 14:48:36 user nova-compute[73079]:     <controller type='ide' index='0'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='ide'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 14:48:36 user nova-compute[73079]:     </controller>
Aug 17 14:48:36 user nova-compute[73079]:     <interface type='ethernet'>
Aug 17 14:48:36 user nova-compute[73079]:       <mac address='fa:16:3e:40:bc:c2'/>
Aug 17 14:48:36 user nova-compute[73079]:       <target dev='tap1ece65d3-f2'/>
Aug 17 14:48:36 user nova-compute[73079]:       <model type='virtio'/>
Aug 17 14:48:36 user nova-compute[73079]:       <mtu size='1442'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='net0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </interface>
Aug 17 14:48:36 user nova-compute[73079]:     <serial type='pty'>
Aug 17 14:48:36 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:36 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:36 user nova-compute[73079]:       <target type='isa-serial' port='0'>
Aug 17 14:48:36 user nova-compute[73079]:         <model name='isa-serial'/>
Aug 17 14:48:36 user nova-compute[73079]:       </target>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </serial>
Aug 17 14:48:36 user nova-compute[73079]:     <console type='pty' tty='/dev/pts/1'>
Aug 17 14:48:36 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:36 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:36 user nova-compute[73079]:       <target type='serial' port='0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </console>
Aug 17 14:48:36 user nova-compute[73079]:     <input type='mouse' bus='ps2'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='input0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </input>
Aug 17 14:48:36 user nova-compute[73079]:     <input type='keyboard' bus='ps2'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='input1'/>
Aug 17 14:48:36 user nova-compute[73079]:     </input>
Aug 17 14:48:36 user nova-compute[73079]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 17 14:48:36 user nova-compute[73079]:       <listen type='address' address='0.0.0.0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </graphics>
Aug 17 14:48:36 user nova-compute[73079]:     <audio id='1' type='none'/>
Aug 17 14:48:36 user nova-compute[73079]:     <video>
Aug 17 14:48:36 user nova-compute[73079]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='video0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </video>
Aug 17 14:48:36 user nova-compute[73079]:     <memballoon model='virtio'>
Aug 17 14:48:36 user nova-compute[73079]:       <stats period='10'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='balloon0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </memballoon>
Aug 17 14:48:36 user nova-compute[73079]:     <rng model='virtio'>
Aug 17 14:48:36 user nova-compute[73079]:       <backend model='random'>/dev/urandom</backend>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='rng0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </rng>
Aug 17 14:48:36 user nova-compute[73079]:   </devices>
Aug 17 14:48:36 user nova-compute[73079]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 14:48:36 user nova-compute[73079]:     <label>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</label>
Aug 17 14:48:36 user nova-compute[73079]:     <imagelabel>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</imagelabel>
Aug 17 14:48:36 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:36 user nova-compute[73079]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 14:48:36 user nova-compute[73079]:     <label>+64055:+108</label>
Aug 17 14:48:36 user nova-compute[73079]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 14:48:36 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:36 user nova-compute[73079]: </domain>
Aug 17 14:48:36 user nova-compute[73079]:  {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface> {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:b5:06"/><model type="virtio"/><mtu size="1442"/><target dev="tapfeb3491c-95"/></interface>not found in domain: <domain type='kvm' id='19'>
Aug 17 14:48:36 user nova-compute[73079]:   <name>instance-0000000f</name>
Aug 17 14:48:36 user nova-compute[73079]:   <uuid>e9d53810-409d-41d6-bae3-b30937b21b25</uuid>
Aug 17 14:48:36 user nova-compute[73079]:   <metadata>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:36 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:35</nova:creationTime>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:36 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:36 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:36 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:36 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:36 user nova-compute[73079]:   </metadata>
Aug 17 14:48:36 user nova-compute[73079]:   <memory unit='KiB'>524288</memory>
Aug 17 14:48:36 user nova-compute[73079]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 14:48:36 user nova-compute[73079]:   <vcpu placement='static'>1</vcpu>
Aug 17 14:48:36 user nova-compute[73079]:   <resource>
Aug 17 14:48:36 user nova-compute[73079]:     <partition>/machine</partition>
Aug 17 14:48:36 user nova-compute[73079]:   </resource>
Aug 17 14:48:36 user nova-compute[73079]:   <sysinfo type='smbios'>
Aug 17 14:48:36 user nova-compute[73079]:     <system>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='version'>0.0.0</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='serial'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='uuid'>e9d53810-409d-41d6-bae3-b30937b21b25</entry>
Aug 17 14:48:36 user nova-compute[73079]:       <entry name='family'>Virtual Machine</entry>
Aug 17 14:48:36 user nova-compute[73079]:     </system>
Aug 17 14:48:36 user nova-compute[73079]:   </sysinfo>
Aug 17 14:48:36 user nova-compute[73079]:   <os>
Aug 17 14:48:36 user nova-compute[73079]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 14:48:36 user nova-compute[73079]:     <boot dev='hd'/>
Aug 17 14:48:36 user nova-compute[73079]:     <smbios mode='sysinfo'/>
Aug 17 14:48:36 user nova-compute[73079]:   </os>
Aug 17 14:48:36 user nova-compute[73079]:   <features>
Aug 17 14:48:36 user nova-compute[73079]:     <acpi/>
Aug 17 14:48:36 user nova-compute[73079]:     <apic/>
Aug 17 14:48:36 user nova-compute[73079]:     <vmcoreinfo state='on'/>
Aug 17 14:48:36 user nova-compute[73079]:   </features>
Aug 17 14:48:36 user nova-compute[73079]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 14:48:36 user nova-compute[73079]:     <model fallback='forbid'>Nehalem</model>
Aug 17 14:48:36 user nova-compute[73079]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 14:48:36 user nova-compute[73079]:     <feature policy='require' name='vme'/>
Aug 17 14:48:36 user nova-compute[73079]:     <feature policy='require' name='x2apic'/>
Aug 17 14:48:36 user nova-compute[73079]:     <feature policy='require' name='hypervisor'/>
Aug 17 14:48:36 user nova-compute[73079]:   </cpu>
Aug 17 14:48:36 user nova-compute[73079]:   <clock offset='utc'>
Aug 17 14:48:36 user nova-compute[73079]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 14:48:36 user nova-compute[73079]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 14:48:36 user nova-compute[73079]:     <timer name='hpet' present='no'/>
Aug 17 14:48:36 user nova-compute[73079]:   </clock>
Aug 17 14:48:36 user nova-compute[73079]:   <on_poweroff>destroy</on_poweroff>
Aug 17 14:48:36 user nova-compute[73079]:   <on_reboot>restart</on_reboot>
Aug 17 14:48:36 user nova-compute[73079]:   <on_crash>destroy</on_crash>
Aug 17 14:48:36 user nova-compute[73079]:   <devices>
Aug 17 14:48:36 user nova-compute[73079]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 14:48:36 user nova-compute[73079]:     <disk type='file' device='disk'>
Aug 17 14:48:36 user nova-compute[73079]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 14:48:36 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk' index='2'/>
Aug 17 14:48:36 user nova-compute[73079]:       <backingStore type='file' index='3'>
Aug 17 14:48:36 user nova-compute[73079]:         <format type='raw'/>
Aug 17 14:48:36 user nova-compute[73079]:         <source file='/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98'/>
Aug 17 14:48:36 user nova-compute[73079]:         <backingStore/>
Aug 17 14:48:36 user nova-compute[73079]:       </backingStore>
Aug 17 14:48:36 user nova-compute[73079]:       <target dev='vda' bus='virtio'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='virtio-disk0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </disk>
Aug 17 14:48:36 user nova-compute[73079]:     <disk type='file' device='cdrom'>
Aug 17 14:48:36 user nova-compute[73079]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 14:48:36 user nova-compute[73079]:       <source file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk.config' index='1'/>
Aug 17 14:48:36 user nova-compute[73079]:       <backingStore/>
Aug 17 14:48:36 user nova-compute[73079]:       <target dev='hda' bus='ide'/>
Aug 17 14:48:36 user nova-compute[73079]:       <readonly/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='ide0-0-0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </disk>
Aug 17 14:48:36 user nova-compute[73079]:     <controller type='usb' index='0' model='none'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='usb'/>
Aug 17 14:48:36 user nova-compute[73079]:     </controller>
Aug 17 14:48:36 user nova-compute[73079]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='pci.0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </controller>
Aug 17 14:48:36 user nova-compute[73079]:     <controller type='ide' index='0'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='ide'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 14:48:36 user nova-compute[73079]:     </controller>
Aug 17 14:48:36 user nova-compute[73079]:     <interface type='ethernet'>
Aug 17 14:48:36 user nova-compute[73079]:       <mac address='fa:16:3e:40:bc:c2'/>
Aug 17 14:48:36 user nova-compute[73079]:       <target dev='tap1ece65d3-f2'/>
Aug 17 14:48:36 user nova-compute[73079]:       <model type='virtio'/>
Aug 17 14:48:36 user nova-compute[73079]:       <mtu size='1442'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='net0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </interface>
Aug 17 14:48:36 user nova-compute[73079]:     <serial type='pty'>
Aug 17 14:48:36 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:36 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:36 user nova-compute[73079]:       <target type='isa-serial' port='0'>
Aug 17 14:48:36 user nova-compute[73079]:         <model name='isa-serial'/>
Aug 17 14:48:36 user nova-compute[73079]:       </target>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </serial>
Aug 17 14:48:36 user nova-compute[73079]:     <console type='pty' tty='/dev/pts/1'>
Aug 17 14:48:36 user nova-compute[73079]:       <source path='/dev/pts/1'/>
Aug 17 14:48:36 user nova-compute[73079]:       <log file='/opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/console.log' append='off'/>
Aug 17 14:48:36 user nova-compute[73079]:       <target type='serial' port='0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='serial0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </console>
Aug 17 14:48:36 user nova-compute[73079]:     <input type='mouse' bus='ps2'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='input0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </input>
Aug 17 14:48:36 user nova-compute[73079]:     <input type='keyboard' bus='ps2'>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='input1'/>
Aug 17 14:48:36 user nova-compute[73079]:     </input>
Aug 17 14:48:36 user nova-compute[73079]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Aug 17 14:48:36 user nova-compute[73079]:       <listen type='address' address='0.0.0.0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </graphics>
Aug 17 14:48:36 user nova-compute[73079]:     <audio id='1' type='none'/>
Aug 17 14:48:36 user nova-compute[73079]:     <video>
Aug 17 14:48:36 user nova-compute[73079]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='video0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </video>
Aug 17 14:48:36 user nova-compute[73079]:     <memballoon model='virtio'>
Aug 17 14:48:36 user nova-compute[73079]:       <stats period='10'/>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='balloon0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </memballoon>
Aug 17 14:48:36 user nova-compute[73079]:     <rng model='virtio'>
Aug 17 14:48:36 user nova-compute[73079]:       <backend model='random'>/dev/urandom</backend>
Aug 17 14:48:36 user nova-compute[73079]:       <alias name='rng0'/>
Aug 17 14:48:36 user nova-compute[73079]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 14:48:36 user nova-compute[73079]:     </rng>
Aug 17 14:48:36 user nova-compute[73079]:   </devices>
Aug 17 14:48:36 user nova-compute[73079]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 14:48:36 user nova-compute[73079]:     <label>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</label>
Aug 17 14:48:36 user nova-compute[73079]:     <imagelabel>libvirt-e9d53810-409d-41d6-bae3-b30937b21b25</imagelabel>
Aug 17 14:48:36 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:36 user nova-compute[73079]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 14:48:36 user nova-compute[73079]:     <label>+64055:+108</label>
Aug 17 14:48:36 user nova-compute[73079]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 14:48:36 user nova-compute[73079]:   </seclabel>
Aug 17 14:48:36 user nova-compute[73079]: </domain>
Aug 17 14:48:36 user nova-compute[73079]:  {{(pid=73079) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 14:48:36 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Detaching interface fa:16:3e:f5:b5:06 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapfeb3491c-95' not found.
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.os_vif_util [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Converting VIF {"id": "feb3491c-9546-421d-9e53-0076237ae7ff", "address": "fa:16:3e:f5:b5:06", "network": {"id": "61f83000-3624-40e8-8a6c-e7c5f4220db9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424577141", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb3491c-95", "ovs_interfaceid": "feb3491c-9546-421d-9e53-0076237ae7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.os_vif_util [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG os_vif [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeb3491c-95, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:48:36 user nova-compute[73079]: INFO os_vif [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b5:06,bridge_name='br-int',has_traffic_filtering=True,id=feb3491c-9546-421d-9e53-0076237ae7ff,network=Network(61f83000-3624-40e8-8a6c-e7c5f4220db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb3491c-95')
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [req-b55468a0-acab-4869-bdf7-362a019d8a76 req-45d1175f-fd72-47a0-a82b-af20964cce70 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:36 user nova-compute[73079]:   <nova:package version="0.0.0"/>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:name>tempest-device-tagging-server-2062491303</nova:name>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:creationTime>2023-08-17 14:48:36</nova:creationTime>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:flavor name="m1.tiny">
Aug 17 14:48:36 user nova-compute[73079]:     <nova:memory>512</nova:memory>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:disk>1</nova:disk>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:swap>0</nova:swap>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:flavor>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:owner>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:user uuid="cea43fd4553b425b85b6eb25a066055d">tempest-TaggedAttachmentsTest-1487335572-project-member</nova:user>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:project uuid="47957ef1019a4623ac6bf81921f1619d">tempest-TaggedAttachmentsTest-1487335572</nova:project>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:owner>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:36 user nova-compute[73079]:   <nova:ports>
Aug 17 14:48:36 user nova-compute[73079]:     <nova:port uuid="1ece65d3-f2d3-4e2d-999c-e91c5d08441f">
Aug 17 14:48:36 user nova-compute[73079]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:48:36 user nova-compute[73079]:     </nova:port>
Aug 17 14:48:36 user nova-compute[73079]:   </nova:ports>
Aug 17 14:48:36 user nova-compute[73079]: </nova:instance>
Aug 17 14:48:36 user nova-compute[73079]:  {{(pid=73079) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a3aee1f9-9a88-47d5-a2a5-e91ed2310289 req-4fda0f90-733d-403e-87b9-2a4fc12047fb service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [{"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Releasing lock "refresh_cache-e9d53810-409d-41d6-bae3-b30937b21b25" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-07c14b3f-a6ac-4944-800d-822b76ebef9f tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "interface-e9d53810-409d-41d6-bae3-b30937b21b25-feb3491c-9546-421d-9e53-0076237ae7ff" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.012s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-807336b7-5510-44e1-b50f-091ad977740b req-dd0a201e-edc4-4e5f-bf73-8a39f55477d6 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-807336b7-5510-44e1-b50f-091ad977740b req-dd0a201e-edc4-4e5f-bf73-8a39f55477d6 service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-807336b7-5510-44e1-b50f-091ad977740b req-dd0a201e-edc4-4e5f-bf73-8a39f55477d6 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-807336b7-5510-44e1-b50f-091ad977740b req-dd0a201e-edc4-4e5f-bf73-8a39f55477d6 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-807336b7-5510-44e1-b50f-091ad977740b req-dd0a201e-edc4-4e5f-bf73-8a39f55477d6 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:37 user nova-compute[73079]: WARNING nova.compute.manager [req-807336b7-5510-44e1-b50f-091ad977740b req-dd0a201e-edc4-4e5f-bf73-8a39f55477d6 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-plugged-feb3491c-9546-421d-9e53-0076237ae7ff for instance with vm_state active and task_state None.
Aug 17 14:48:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-f6e4c3a8-0552-46cb-aa49-102881e833aa. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG nova.network.neutron [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG nova.network.neutron [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG nova.network.neutron [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c1632112-ffe8-4942-95fe-5db1975aec78 req-c1f81980-3ca5-4286-9537-6ea628e7c56d service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: 38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-f27e3ac4-e193-4548-8b1c-5e40392ad172. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-38516260-e21b-433d-9794-cfad25c6c377. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port 38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:40 user nova-compute[73079]: DEBUG nova.network.neutron [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:48:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-191f1306-1833-44c1-9402-bf01f5fc52ff req-5740a44f-f8e2-43ab-82e5-cf29af9f4aa1 service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: 6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Successfully updated port: 6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-e801876f-843a-465b-86d6-3e90f64ef441. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:48:43 user nova-compute[73079]: INFO nova.compute.claims [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Claim successful on node user
Aug 17 14:48:43 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:48:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.policy [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7edb85ca3cd14d4587b951327e892bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac38bd75ed4e588b516582286bfb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:48:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Creating image(s)
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: INFO nova.virt.block_device [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Booting with volume e642aadd-1c4e-4150-a11c-404642ef6b9c at /dev/vdb
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG os_brick.utils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7122e-aa17-4c67-89dd-7c91983dced3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d72a297-724a-464e-8920-fbc8c2ca2941]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a4669-1cd2-44c8-a354-aac6cfd96a66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a41c3a-c12a-4a40-9c4a-e2768299ea6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:44 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a5f5f8-ac5d-444b-bc54-538f13e05a17]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG os_brick.utils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating existing volume attachment record: 42d08621-83c3-4c98-b929-e1f616b3a3bd {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk 1073741824" returned: 0 in 0.063s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance network_info: |[{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Successfully created port: abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Cannot resize image /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'migration_context' on Instance uuid 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Ensure instance console log exists: /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updated VIF entry in instance network info cache for port e801876f-843a-465b-86d6-3e90f64ef441. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-6522ab6c-714a-495e-9eef-e57f249ed0cc. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port 6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updated VIF entry in instance network info cache for port 6522ab6c-714a-495e-9eef-e57f249ed0cc. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-6d86f32c-18ab-4066-b086-7e2db728812a. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port 6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Successfully updated port: abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquired lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-changed-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Refreshing instance network info cache due to event network-changed-abb92137-be34-4f1d-b0d4-72f3ba157584. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] Acquiring lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:48:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updated VIF entry in instance network info cache for port 6d86f32c-18ab-4066-b086-7e2db728812a. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-681eb5f5-a554-409a-bfce-673213004e1f req-38457e42-26bc-42bc-850c-0f8bfbd893a6 service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updating instance_info_cache with network_info: [{"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Releasing lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Instance network_info: |[{"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] Acquired lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Refreshing network info cache for port abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Start _get_guest_xml network_info=[{"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:48:46 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:48:46 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1257922660',display_name='tempest-AttachVolumeNegativeTest-server-1257922660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1257922660',id=18,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqzxGJ0jWB4mCs2Td5ldb9tB5uyj4309CRlVfTVVSWaP8r60jz4P/T0NIIjsQ8vuxvg8cKjOFFGtzQ9ojV4Zesift1Kc0HDJ/jHmSiXlxVuj84R/t5nI3ytQ3CmfxY2rw==',key_name='tempest-keypair-1401690174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-i39arlm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=1bbf6615-32dd-41eb-a14c-685476f49c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:48:46 user nova-compute[73079]:   <uuid>1bbf6615-32dd-41eb-a14c-685476f49c5b</uuid>
Aug 17 14:48:46 user nova-compute[73079]:   <name>instance-00000012</name>
Aug 17 14:48:46 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:48:46 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:48:46 user nova-compute[73079]:   <metadata>
Aug 17 14:48:46 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:48:46 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:48:46 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1257922660</nova:name>
Aug 17 14:48:46 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:48:46</nova:creationTime>
Aug 17 14:48:46 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:48:46 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:48:46 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:48:46 user nova-compute[73079]:       <nova:owner>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:user uuid="7edb85ca3cd14d4587b951327e892bd6">tempest-AttachVolumeNegativeTest-706656920-project-member</nova:user>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:project uuid="04ac38bd75ed4e588b516582286bfb97">tempest-AttachVolumeNegativeTest-706656920</nova:project>
Aug 17 14:48:46 user nova-compute[73079]:       </nova:owner>
Aug 17 14:48:46 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:48:46 user nova-compute[73079]:       <nova:ports>
Aug 17 14:48:46 user nova-compute[73079]:         <nova:port uuid="abb92137-be34-4f1d-b0d4-72f3ba157584">
Aug 17 14:48:46 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 14:48:46 user nova-compute[73079]:         </nova:port>
Aug 17 14:48:46 user nova-compute[73079]:       </nova:ports>
Aug 17 14:48:46 user nova-compute[73079]:     </nova:instance>
Aug 17 14:48:46 user nova-compute[73079]:   </metadata>
Aug 17 14:48:46 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:48:46 user nova-compute[73079]:     <system>
Aug 17 14:48:46 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:48:46 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:48:46 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:48:46 user nova-compute[73079]:       <entry name="serial">1bbf6615-32dd-41eb-a14c-685476f49c5b</entry>
Aug 17 14:48:46 user nova-compute[73079]:       <entry name="uuid">1bbf6615-32dd-41eb-a14c-685476f49c5b</entry>
Aug 17 14:48:46 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:48:46 user nova-compute[73079]:     </system>
Aug 17 14:48:46 user nova-compute[73079]:   </sysinfo>
Aug 17 14:48:46 user nova-compute[73079]:   <os>
Aug 17 14:48:46 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:48:46 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:48:46 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:48:46 user nova-compute[73079]:   </os>
Aug 17 14:48:46 user nova-compute[73079]:   <features>
Aug 17 14:48:46 user nova-compute[73079]:     <acpi/>
Aug 17 14:48:46 user nova-compute[73079]:     <apic/>
Aug 17 14:48:46 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:48:46 user nova-compute[73079]:   </features>
Aug 17 14:48:46 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:48:46 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:48:46 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:48:46 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:48:46 user nova-compute[73079]:   </clock>
Aug 17 14:48:46 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:48:46 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:48:46 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:48:46 user nova-compute[73079]:   </cpu>
Aug 17 14:48:46 user nova-compute[73079]:   <devices>
Aug 17 14:48:46 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:48:46 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:48:46 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk"/>
Aug 17 14:48:46 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:48:46 user nova-compute[73079]:     </disk>
Aug 17 14:48:46 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:48:46 user nova-compute[73079]:       <mac address="fa:16:3e:04:fd:55"/>
Aug 17 14:48:46 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:48:46 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:48:46 user nova-compute[73079]:       <target dev="tapabb92137-be"/>
Aug 17 14:48:46 user nova-compute[73079]:     </interface>
Aug 17 14:48:46 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:48:46 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/console.log" append="off"/>
Aug 17 14:48:46 user nova-compute[73079]:     </serial>
Aug 17 14:48:46 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:48:46 user nova-compute[73079]:     <video>
Aug 17 14:48:46 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:48:46 user nova-compute[73079]:     </video>
Aug 17 14:48:46 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:48:46 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:48:46 user nova-compute[73079]:     </rng>
Aug 17 14:48:46 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:48:46 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:48:46 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:48:46 user nova-compute[73079]:     </memballoon>
Aug 17 14:48:46 user nova-compute[73079]:   </devices>
Aug 17 14:48:46 user nova-compute[73079]: </domain>
Aug 17 14:48:46 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1257922660',display_name='tempest-AttachVolumeNegativeTest-server-1257922660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1257922660',id=18,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqzxGJ0jWB4mCs2Td5ldb9tB5uyj4309CRlVfTVVSWaP8r60jz4P/T0NIIjsQ8vuxvg8cKjOFFGtzQ9ojV4Zesift1Kc0HDJ/jHmSiXlxVuj84R/t5nI3ytQ3CmfxY2rw==',key_name='tempest-keypair-1401690174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-i39arlm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=1bbf6615-32dd-41eb-a14c-685476f49c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG os_vif [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabb92137-be, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabb92137-be, col_values=(('external_ids', {'iface-id': 'abb92137-be34-4f1d-b0d4-72f3ba157584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:fd:55', 'vm-uuid': '1bbf6615-32dd-41eb-a14c-685476f49c5b'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:46 user nova-compute[73079]: INFO os_vif [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be')
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:04:fd:55, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updated VIF entry in instance network info cache for port abb92137-be34-4f1d-b0d4-72f3ba157584. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updating instance_info_cache with network_info: [{"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-41ec4f0c-7b29-409b-85a5-7276c65a344a req-7d48ac46-a562-48c7-8d51-d1e59029f69a service nova] Releasing lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:48:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-5ed01b4f-caa3-4f0b-bde2-b229c2d6c8a6 req-d2eb69f2-2423-4a23-b66e-eb5c6ffa95e0 service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5ed01b4f-caa3-4f0b-bde2-b229c2d6c8a6 req-d2eb69f2-2423-4a23-b66e-eb5c6ffa95e0 service nova] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5ed01b4f-caa3-4f0b-bde2-b229c2d6c8a6 req-d2eb69f2-2423-4a23-b66e-eb5c6ffa95e0 service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5ed01b4f-caa3-4f0b-bde2-b229c2d6c8a6 req-d2eb69f2-2423-4a23-b66e-eb5c6ffa95e0 service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-5ed01b4f-caa3-4f0b-bde2-b229c2d6c8a6 req-d2eb69f2-2423-4a23-b66e-eb5c6ffa95e0 service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] No waiting events found dispatching network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:48 user nova-compute[73079]: WARNING nova.compute.manager [req-5ed01b4f-caa3-4f0b-bde2-b229c2d6c8a6 req-d2eb69f2-2423-4a23-b66e-eb5c6ffa95e0 service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received unexpected event network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 for instance with vm_state building and task_state spawning.
Aug 17 14:48:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:49 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283729.9754288, 1bbf6615-32dd-41eb-a14c-685476f49c5b => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:48:49 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] VM Resumed (Lifecycle Event)
Aug 17 14:48:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:48:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:48:49 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Instance spawned successfully.
Aug 17 14:48:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:48:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:48:50 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283729.9772346, 1bbf6615-32dd-41eb-a14c-685476f49c5b => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:48:50 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] VM Started (Lifecycle Event)
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:48:50 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:48:50 user nova-compute[73079]: INFO nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:48:50 user nova-compute[73079]: INFO nova.compute.manager [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Took 6.61 seconds to build instance.
Aug 17 14:48:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c7ecc4e8-b5ba-4e55-86db-ab570777ac30 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.756s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-ebc7b2ca-7d35-40ac-91d2-6007005bde60 req-b9f1b0d1-d586-4d0f-a062-f9b1bde226bd service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ebc7b2ca-7d35-40ac-91d2-6007005bde60 req-b9f1b0d1-d586-4d0f-a062-f9b1bde226bd service nova] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ebc7b2ca-7d35-40ac-91d2-6007005bde60 req-b9f1b0d1-d586-4d0f-a062-f9b1bde226bd service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ebc7b2ca-7d35-40ac-91d2-6007005bde60 req-b9f1b0d1-d586-4d0f-a062-f9b1bde226bd service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-ebc7b2ca-7d35-40ac-91d2-6007005bde60 req-b9f1b0d1-d586-4d0f-a062-f9b1bde226bd service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] No waiting events found dispatching network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:50 user nova-compute[73079]: WARNING nova.compute.manager [req-ebc7b2ca-7d35-40ac-91d2-6007005bde60 req-b9f1b0d1-d586-4d0f-a062-f9b1bde226bd service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received unexpected event network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 for instance with vm_state active and task_state None.
Aug 17 14:48:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:51 user nova-compute[73079]: INFO nova.compute.manager [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Terminating instance
Aug 17 14:48:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a3911d3-3260-44aa-b98f-6cdfe2b142c5 req-fd180030-e58a-48c2-a5fa-89df1275df5e service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-unplugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a3911d3-3260-44aa-b98f-6cdfe2b142c5 req-fd180030-e58a-48c2-a5fa-89df1275df5e service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a3911d3-3260-44aa-b98f-6cdfe2b142c5 req-fd180030-e58a-48c2-a5fa-89df1275df5e service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a3911d3-3260-44aa-b98f-6cdfe2b142c5 req-fd180030-e58a-48c2-a5fa-89df1275df5e service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a3911d3-3260-44aa-b98f-6cdfe2b142c5 req-fd180030-e58a-48c2-a5fa-89df1275df5e service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-unplugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a3911d3-3260-44aa-b98f-6cdfe2b142c5 req-fd180030-e58a-48c2-a5fa-89df1275df5e service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-unplugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:48:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Instance destroyed successfully.
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lazy-loading 'resources' on Instance uuid 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-307142343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1807850676',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq9zO9T/lSSvO4QLehADGZzJc7bYUBIPgnANEDieXE5JLP9mBiULljyHZTfMZqXKbWrnnui8Rk/GnLkz4Hv78LmqRtHLA9c24KJAQUpRVAqSLPws1XinirRIeFeYLuQag==',key_name='tempest-keypair-353563461',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7065c3e6c348ae929d7a53011117a4',ramdisk_id='',reservation_id='r-0e3y0gw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1796114192',owner_user_name='tempest-ServerActionsV293TestJSON-1796114192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5961828bebbf4a8b9168d8e7f91fe738',uuid=07c1ea4d-000b-4352-8284-5d2b1f1dfaa7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converting VIF {"id": "17ae6a67-9f51-487e-b36d-83690838779b", "address": "fa:16:3e:54:86:6a", "network": {"id": "72c0064e-2846-4ed0-b237-d2eec7ba3450", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-391778820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7065c3e6c348ae929d7a53011117a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17ae6a67-9f", "ovs_interfaceid": "17ae6a67-9f51-487e-b36d-83690838779b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_vif [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17ae6a67-9f, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:52 user nova-compute[73079]: INFO os_vif [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:86:6a,bridge_name='br-int',has_traffic_filtering=True,id=17ae6a67-9f51-487e-b36d-83690838779b,network=Network(72c0064e-2846-4ed0-b237-d2eec7ba3450),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17ae6a67-9f')
Aug 17 14:48:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTPGKOdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:52 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b325959-d8ac-4e7c-8d82-5193f2da2fe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9709e1-fd90-47b4-affb-d3f140163ece]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:52 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:52 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:52 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:52 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:52 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:52 user nova-compute[73079]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f (non-flash)
Aug 17 14:48:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8657d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027cdcc-9be8-4840-9ec0-86197e6c735d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d398119-822e-4fb3-b918-84ad330e3ea6]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3653310-4e84-40fb-82da-bae61d8050d6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:48:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fda3f0d-cea0-4483-821d-534b571dd659]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea63b3-6c1b-4ffc-a788-bab97daea1c1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[74490f94-cf87-4f96-82d5-667de5ecf4d3]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260]
Aug 17 14:48:53 user nova-compute[73079]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f, portal: 172.16.0.220,3260] successful.
Aug 17 14:48:53 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae8ed0a-6053-46f5-adeb-f7fee6aca52f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa5839-acf3-4457-b611-e1453ff88431]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] <== disconnect_volume: return (335ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:48:53 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Deleting instance files /opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7_del
Aug 17 14:48:53 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Deletion of /opt/stack/data/nova/instances/07c1ea4d-000b-4352-8284-5d2b1f1dfaa7_del complete
Aug 17 14:48:53 user nova-compute[73079]: INFO nova.compute.manager [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 17 14:48:53 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:48:53 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:48:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a21726d-774b-43a3-9191-3ab3cedb9326 req-f79fde45-5c65-48d1-b472-4d5ddfb95bb0 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a21726d-774b-43a3-9191-3ab3cedb9326 req-f79fde45-5c65-48d1-b472-4d5ddfb95bb0 service nova] Acquiring lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a21726d-774b-43a3-9191-3ab3cedb9326 req-f79fde45-5c65-48d1-b472-4d5ddfb95bb0 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a21726d-774b-43a3-9191-3ab3cedb9326 req-f79fde45-5c65-48d1-b472-4d5ddfb95bb0 service nova] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a21726d-774b-43a3-9191-3ab3cedb9326 req-f79fde45-5c65-48d1-b472-4d5ddfb95bb0 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] No waiting events found dispatching network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:54 user nova-compute[73079]: WARNING nova.compute.manager [req-7a21726d-774b-43a3-9191-3ab3cedb9326 req-f79fde45-5c65-48d1-b472-4d5ddfb95bb0 service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received unexpected event network-vif-plugged-17ae6a67-9f51-487e-b36d-83690838779b for instance with vm_state active and task_state deleting.
Aug 17 14:48:55 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:55 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Took 1.89 seconds to deallocate network for instance.
Aug 17 14:48:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-3d4282ee-0b4d-4982-bf5d-c6a1de6ebb46 req-e064a4a4-1deb-4c15-81a1-59c09d8c141e service nova] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Received event network-vif-deleted-17ae6a67-9f51-487e-b36d-83690838779b {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:56 user nova-compute[73079]: INFO nova.compute.manager [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Terminating instance
Aug 17 14:48:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:56 user nova-compute[73079]: INFO nova.virt.block_device [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Booting with volume daa3b5a8-4d51-4da9-b701-ab8012b76f63 at /dev/vdc
Aug 17 14:48:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-14f9010e-f482-4aae-bdce-7d6c0ef891c4 req-746ae8e0-943e-4d6c-9e5c-f7a1a86cee22 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-14f9010e-f482-4aae-bdce-7d6c0ef891c4 req-746ae8e0-943e-4d6c-9e5c-f7a1a86cee22 service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-14f9010e-f482-4aae-bdce-7d6c0ef891c4 req-746ae8e0-943e-4d6c-9e5c-f7a1a86cee22 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-14f9010e-f482-4aae-bdce-7d6c0ef891c4 req-746ae8e0-943e-4d6c-9e5c-f7a1a86cee22 service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-14f9010e-f482-4aae-bdce-7d6c0ef891c4 req-746ae8e0-943e-4d6c-9e5c-f7a1a86cee22 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-14f9010e-f482-4aae-bdce-7d6c0ef891c4 req-746ae8e0-943e-4d6c-9e5c-f7a1a86cee22 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-unplugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG os_brick.utils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81d6ae-658e-4bab-b3b8-1f4e7687eca0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a32ea58-6df9-4e93-9029-58a2e85e6ec5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[69922205-f282-4b7c-9c78-d6435a3030bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c4b21-d58d-45a5-8b8a-4580e4eed44f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:48:56 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:48:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0243fd50-cad4-4cde-9c59-31dc424f5e66]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG os_brick.utils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== get_connector_properties: return (256ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:56 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating existing volume attachment record: 00abf853-f138-4a4b-9de0-18acef4e414b {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:48:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Instance destroyed successfully.
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lazy-loading 'resources' on Instance uuid 9d2c4290-ec0a-4dc3-8afa-552487ac923f {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1550667638',display_name='tempest-ServerActionsTestOtherB-server-1550667638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1550667638',id=3,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffkmZ0WK7dzXi3X9I3tbPIYdkTUurWinQpzrMW9mPwZvzjmi9JbtIHi53mdBSMTRgdpL6cSTMmSAVi3Hfq1MbR0lPAgoG1vu5nOqyvZsrgpOYIi0KCetdaxVJ1kiUfWw==',key_name='tempest-keypair-914849723',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7fcbaf2803041bc9a038147e2d03356',ramdisk_id='',reservation_id='r-9hduon70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1211659744',owner_user_name='tempest-ServerActionsTestOtherB-1211659744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58b4647e94614c84a7b0b77de3aa4e03',uuid=9d2c4290-ec0a-4dc3-8afa-552487ac923f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converting VIF {"id": "5955a467-f321-452d-812d-4796e5b7d6df", "address": "fa:16:3e:34:d7:35", "network": {"id": "001ab6f8-cfc2-4257-8e34-495595b3659f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1104186658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7fcbaf2803041bc9a038147e2d03356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5955a467-f3", "ovs_interfaceid": "5955a467-f321-452d-812d-4796e5b7d6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_vif [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5955a467-f3, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:48:57 user nova-compute[73079]: INFO os_vif [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=5955a467-f321-452d-812d-4796e5b7d6df,network=Network(001ab6f8-cfc2-4257-8e34-495595b3659f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5955a467-f3')
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YWXhsifn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:48:57 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b4c50-f0fa-438a-83a3-2c16d02a67ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f832a-e4a6-49e7-a924-da540722b0e3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:57 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:57 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 (non-flash)
Aug 17 14:48:57 user nova-compute[73079]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:48:57 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:48:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f78dd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b52ae4-8b73-4837-b3cd-88b2a3599343]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d346dadd-842c-44f9-b6ab-44a07589451f]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6518ff0-9295-4fe9-9ecd-0e4ddf844e7f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef43f8-711f-4274-a4fc-ce40a2180c56]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e98dfc-5169-4fa2-bf1d-882e77baf6e4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bd454-74ae-4a02-9aba-90aaa81e75f3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260]
Aug 17 14:48:57 user nova-compute[73079]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783, portal: 172.16.0.220,3260] successful.
Aug 17 14:48:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a8cdb1e-3a9f-4cba-8ea8-9a4a7d90d783 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4b936-1b43-44b8-9ce9-9cad4fab930f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] <== disconnect_volume: return (303ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:48:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Deleting instance files /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f_del
Aug 17 14:48:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Deletion of /opt/stack/data/nova/instances/9d2c4290-ec0a-4dc3-8afa-552487ac923f_del complete
Aug 17 14:48:57 user nova-compute[73079]: INFO nova.compute.manager [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 17 14:48:57 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:48:57 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:48:58 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:48:58 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Took 1.04 seconds to deallocate network for instance.
Aug 17 14:48:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-9412317c-9ff6-4d6d-a6a2-ae6b3b54a408 req-87192520-ca62-46c4-a056-eb07f6a50986 service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-deleted-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-3af32e49-8128-4cb2-9bce-76f642bc8fd2 req-f13228c1-c05f-415c-b795-8dce0d77594f service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:48:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3af32e49-8128-4cb2-9bce-76f642bc8fd2 req-f13228c1-c05f-415c-b795-8dce0d77594f service nova] Acquiring lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:48:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3af32e49-8128-4cb2-9bce-76f642bc8fd2 req-f13228c1-c05f-415c-b795-8dce0d77594f service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:48:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3af32e49-8128-4cb2-9bce-76f642bc8fd2 req-f13228c1-c05f-415c-b795-8dce0d77594f service nova] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:48:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-3af32e49-8128-4cb2-9bce-76f642bc8fd2 req-f13228c1-c05f-415c-b795-8dce0d77594f service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] No waiting events found dispatching network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:48:58 user nova-compute[73079]: WARNING nova.compute.manager [req-3af32e49-8128-4cb2-9bce-76f642bc8fd2 req-f13228c1-c05f-415c-b795-8dce0d77594f service nova] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Received unexpected event network-vif-plugged-5955a467-f321-452d-812d-4796e5b7d6df for instance with vm_state active and task_state deleting.
Aug 17 14:49:01 user nova-compute[73079]: INFO nova.compute.manager [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Took 6.63 seconds to detach 1 volumes for instance.
Aug 17 14:49:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Deleting volume: 0ae8ed0a-6053-46f5-adeb-f7fee6aca52f {{(pid=73079) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "a2c17473-d65d-4a2b-8382-ac868705c232" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:01 user nova-compute[73079]: INFO nova.compute.manager [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Terminating instance
Aug 17 14:49:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:02 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Deleted allocations for instance 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-7f83e623-7ce2-4003-a028-948943576e31 req-40547d29-4bbb-4757-a75c-bddc9f06e748 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-vif-unplugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7f83e623-7ce2-4003-a028-948943576e31 req-40547d29-4bbb-4757-a75c-bddc9f06e748 service nova] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7f83e623-7ce2-4003-a028-948943576e31 req-40547d29-4bbb-4757-a75c-bddc9f06e748 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7f83e623-7ce2-4003-a028-948943576e31 req-40547d29-4bbb-4757-a75c-bddc9f06e748 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-7f83e623-7ce2-4003-a028-948943576e31 req-40547d29-4bbb-4757-a75c-bddc9f06e748 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] No waiting events found dispatching network-vif-unplugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-7f83e623-7ce2-4003-a028-948943576e31 req-40547d29-4bbb-4757-a75c-bddc9f06e748 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-vif-unplugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-67f3c85b-f27a-4ce3-af0a-64429ebb621c tempest-ServerActionsV293TestJSON-1796114192 tempest-ServerActionsV293TestJSON-1796114192-project-member] Lock "07c1ea4d-000b-4352-8284-5d2b1f1dfaa7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.488s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Instance destroyed successfully.
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lazy-loading 'resources' on Instance uuid a2c17473-d65d-4a2b-8382-ac868705c232 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1861721010',display_name='tempest-ServersNegativeTestJSON-server-1861721010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1861721010',id=1,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40c83cb8ee234c77bf65a94c176b47b5',ramdisk_id='',reservation_id='r-efdcvdwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-146357167',owner_user_name='tempest-ServersNegativeTestJSON-146357167-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:40:28Z,user_data=None,user_id='8ae8ba1f04474c00be03b2d8ea745f97',uuid=a2c17473-d65d-4a2b-8382-ac868705c232,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converting VIF {"id": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "address": "fa:16:3e:16:2d:32", "network": {"id": "79530b93-0d54-4e04-a69d-24e985e49490", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-836528716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40c83cb8ee234c77bf65a94c176b47b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe07d83-20", "ovs_interfaceid": "dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG os_vif [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbe07d83-20, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:02 user nova-compute[73079]: INFO os_vif [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5,network=Network(79530b93-0d54-4e04-a69d-24e985e49490),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe07d83-20')
Aug 17 14:49:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Deleting instance files /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232_del
Aug 17 14:49:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Deletion of /opt/stack/data/nova/instances/a2c17473-d65d-4a2b-8382-ac868705c232_del complete
Aug 17 14:49:02 user nova-compute[73079]: INFO nova.compute.manager [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 17 14:49:02 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:49:02 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:49:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:03 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:49:03 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Took 0.68 seconds to deallocate network for instance.
Aug 17 14:49:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:03 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:49:03 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:49:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:03 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Deleted allocations for instance a2c17473-d65d-4a2b-8382-ac868705c232
Aug 17 14:49:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0d5a62f4-23a1-4c9d-8eb9-702753692a8f tempest-ServersNegativeTestJSON-146357167 tempest-ServersNegativeTestJSON-146357167-project-member] Lock "a2c17473-d65d-4a2b-8382-ac868705c232" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] Acquiring lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] Lock "a2c17473-d65d-4a2b-8382-ac868705c232-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] No waiting events found dispatching network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:04 user nova-compute[73079]: WARNING nova.compute.manager [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received unexpected event network-vif-plugged-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 for instance with vm_state deleted and task_state None.
Aug 17 14:49:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-7643425e-9842-4fec-ad48-2dffc25f3ef5 req-f78e0980-a7d8-4784-a5b4-98a50c16ddd7 service nova] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Received event network-vif-deleted-dbe07d83-20cc-4035-9b7b-bd0fde2ec5f5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283732.7614405, 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:07 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] VM Stopped (Lifecycle Event)
Aug 17 14:49:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2680443e-1dde-479f-805c-4ee57d7eee1b None None] [instance: 07c1ea4d-000b-4352-8284-5d2b1f1dfaa7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:49:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:49:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7967MB free_disk=25.665130615234375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e9d53810-409d-41d6-bae3-b30937b21b25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 4c729310-f0a9-4faf-ab22-02c440738a43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance f9b2e33c-dfb8-45b9-94ed-02563cac358d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1bbf6615-32dd-41eb-a14c-685476f49c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:49:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:09 user nova-compute[73079]: INFO nova.compute.manager [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Took 10.67 seconds to detach 1 volumes for instance.
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:09 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Deleted allocations for instance 9d2c4290-ec0a-4dc3-8afa-552487ac923f
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:49:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Creating image(s)
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Ensure instance console log exists: /opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Start _get_guest_xml network_info=[{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '6520f7bb-e57c-4175-a2e9-706d821a9e17', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOhbjdBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d', 'attached_at': '', 'detached_at': '', 'volume_id': '98e3aadd-8b61-4a44-b7a8-7ebcc281313f', 'serial': '98e3aadd-8b61-4a44-b7a8-7ebcc281313f'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '42d08621-83c3-4c98-b929-e1f616b3a3bd', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMVRQXlk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e642aadd-1c4e-4150-a11c-404642ef6b9c', 'serial': 'e642aadd-1c4e-4150-a11c-404642ef6b9c'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '00abf853-f138-4a4b-9de0-18acef4e414b', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyoDpMEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa3b5a8-4d51-4da9-b701-ab8012b76f63', 'serial': 'daa3b5a8-4d51-4da9-b701-ab8012b76f63'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:49:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:49:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOhbjdBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:49:09 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:09 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:09 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4f07ef2f-ef69-491f-af43-84a5858b038a tempest-ServerActionsTestOtherB-1211659744 tempest-ServerActionsTestOtherB-1211659744-project-member] Lock "9d2c4290-ec0a-4dc3-8afa-552487ac923f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.431s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8db21-35ce-46f0-aaad-085e1a9e1328]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:49:09 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb73d23-ebd7-4484-90c5-22afa6310655]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f] added
Aug 17 14:49:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb350c30-3311-44f3-8219-1112baf41761]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3781806-aadc-4c70-b91f-54846966a2d3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOhbjdBS {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fOhbjdBS" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f4d64-9f34-4187-9f71-778d7a0f2e58]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fOhbjdBS'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8653702-a539-469b-b487-41f35b71c0c0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a3fa7-9593-409a-a9af-49fae8102ec3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc6807b-daaf-4529-84cb-b3626b3e862a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260]
Aug 17 14:49:09 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260] successful.
Aug 17 14:49:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[52446af8-ffea-4ca2-9df7-ce232c81dcf1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d53b05-855f-40ee-878d-c642ecc0745c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:09 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cdbc74-2cef-4c4e-9f19-07d844a0e02a]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [{"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOhbjdBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23232376232386135', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:49:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232376232386135', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMVRQXlk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:49:11 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:11 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:11 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7705b28d-1b84-4072-b8c1-32c7ffeff04e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:49:11 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82601d6e-d8f9-4059-b759-85adc696b3a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c] added
Aug 17 14:49:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fa9afe-13b9-49d3-97fa-0743f61eec3c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b823c47e-5d8e-46f6-be24-747d10178be5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMVRQXlk {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMVRQXlk" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4bd9a9-da5c-495b-98e8-26761df84eba]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pMVRQXlk'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eedf607-a1b6-483e-bbf7-b15c5a7d3c44]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c1c3c5-4534-4aa7-bf91-7df278aca355]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd432fe2-3e34-43ba-ad9f-d908afd8d675]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260]
Aug 17 14:49:11 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260] successful.
Aug 17 14:49:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[138da7b6-2a95-416f-b6d3-f053544bce9c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a30d66-c234-4981-893e-6896cfa7917a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:11 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a5cce1-ae72-43b9-81f7-33f6d2070e06]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMVRQXlk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:11 user nova-compute[73079]: INFO nova.compute.manager [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Detaching volume 95d5ab03-90ad-424f-87aa-26517212d148
Aug 17 14:49:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:11 user nova-compute[73079]: INFO nova.virt.block_device [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Attempting to driver detach volume 95d5ab03-90ad-424f-87aa-26517212d148 from mountpoint /dev/vdc
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Attempting to detach device vdc from instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:49:11 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:49:11 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:49:11 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:49:11 user nova-compute[73079]:   <serial>95d5ab03-90ad-424f-87aa-26517212d148</serial>
Aug 17 14:49:11 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 14:49:11 user nova-compute[73079]: </disk>
Aug 17 14:49:11 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:49:11 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully detached device vdc from instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 from the persistent domain config.
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:49:11 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:49:11 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:49:11 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:49:11 user nova-compute[73079]:   <serial>95d5ab03-90ad-424f-87aa-26517212d148</serial>
Aug 17 14:49:11 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 14:49:11 user nova-compute[73079]: </disk>
Aug 17 14:49:11 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692283751.8493211, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:49:11 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully detached device vdc from instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 from the live domain config.
Aug 17 14:49:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhWbdqyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:49:11 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283737.055167, 9d2c4290-ec0a-4dc3-8afa-552487ac923f => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:12 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] VM Stopped (Lifecycle Event)
Aug 17 14:49:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3ad9ccf7-da5e-42b5-a688-c8da848266ae None None] [instance: 9d2c4290-ec0a-4dc3-8afa-552487ac923f] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26335376164633333', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335376164633333', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.492s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyoDpMEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:49:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ef436-a291-41dc-aef7-5f939b0f641c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd699e-3059-4adb-9e71-f388b6428f40]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f77b3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a74f1f8-c0ca-4b74-bae6-c4779cb87d9a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc66899-68b3-4b35-a9a4-efe0d4d2a3e4]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b221ad-156d-4285-a80c-ec38bc692812]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039c1f9-2c33-4f87-ba8e-95f4710523bc]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d96d14b-9654-441c-aae0-308d60e9d3d0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b81f0-c1b2-4218-a1f2-76a8cc315b30]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260]
Aug 17 14:49:12 user nova-compute[73079]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148, portal: 172.16.0.220,3260] successful.
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95d5ab03-90ad-424f-87aa-26517212d148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da88ad5-5fd3-4aef-a46e-ed06a820a039]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] <== disconnect_volume: return (784ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.272s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:12 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c498d-a240-44d0-8dde-81551d2e4569]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:49:12 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab04e7-f669-4bd1-87ff-50b5ad17d429]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63] added
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba0006-017c-409e-ac4a-0b2732c3bfbd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1be879-f4bb-4b5e-a922-c31a93008df3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyoDpMEz {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyoDpMEz" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a353a77a-291c-4489-b696-d4fb09c150a9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyoDpMEz'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b697a5-f182-4490-81f4-fe96c5cc8462]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe954d6-daf7-4505-8492-15d73d1899fd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d7a711-2613-4476-a2bc-e6eb141438ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260]
Aug 17 14:49:12 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260] successful.
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb297df9-7749-4aca-9894-a4c6b6b3be7a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[76227fdc-f459-4fe3-b720-6c211fb21e54]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:12 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:49:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154fe09-9204-4a48-ab15-51b07215157e]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:49:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyoDpMEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:49:13 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'flavor' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:49:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9eb90270-f8d8-4c76-9779-c5767e5740e2 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.097s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== connect_volume: return (1604ms) {'type': 'block', 'scsi_wwn': '26637356165343731', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:49:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637356165343731', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b2e33c-dfb8-45b9-94ed-02563cac358d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:49:14 user nova-compute[73079]:   <uuid>f9b2e33c-dfb8-45b9-94ed-02563cac358d</uuid>
Aug 17 14:49:14 user nova-compute[73079]:   <name>instance-00000011</name>
Aug 17 14:49:14 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:49:14 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:49:14 user nova-compute[73079]:   <metadata>
Aug 17 14:49:14 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:49:14 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:49:14 user nova-compute[73079]:       <nova:name>tempest-device-tagging-server-82034825</nova:name>
Aug 17 14:49:14 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:49:09</nova:creationTime>
Aug 17 14:49:14 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:49:14 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:49:14 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:49:14 user nova-compute[73079]:       <nova:owner>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:user uuid="6178e46fa30a4646bf886fbd84aefe7d">tempest-TaggedBootDevicesTest-1175207045-project-member</nova:user>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:project uuid="cfe62d7ce38d45b2b8ed21a331aa7cd4">tempest-TaggedBootDevicesTest-1175207045</nova:project>
Aug 17 14:49:14 user nova-compute[73079]:       </nova:owner>
Aug 17 14:49:14 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:49:14 user nova-compute[73079]:       <nova:ports>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="8e7ad6a3-fd35-44cd-8295-912e199b872c">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="f6e4c3a8-0552-46cb-aa49-102881e833aa">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="f27e3ac4-e193-4548-8b1c-5e40392ad172">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="38516260-e21b-433d-9794-cfad25c6c377">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="e801876f-843a-465b-86d6-3e90f64ef441">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="6522ab6c-714a-495e-9eef-e57f249ed0cc">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:         <nova:port uuid="6d86f32c-18ab-4066-b086-7e2db728812a">
Aug 17 14:49:14 user nova-compute[73079]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 14:49:14 user nova-compute[73079]:         </nova:port>
Aug 17 14:49:14 user nova-compute[73079]:       </nova:ports>
Aug 17 14:49:14 user nova-compute[73079]:     </nova:instance>
Aug 17 14:49:14 user nova-compute[73079]:   </metadata>
Aug 17 14:49:14 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:49:14 user nova-compute[73079]:     <system>
Aug 17 14:49:14 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:49:14 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:49:14 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:49:14 user nova-compute[73079]:       <entry name="serial">f9b2e33c-dfb8-45b9-94ed-02563cac358d</entry>
Aug 17 14:49:14 user nova-compute[73079]:       <entry name="uuid">f9b2e33c-dfb8-45b9-94ed-02563cac358d</entry>
Aug 17 14:49:14 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:49:14 user nova-compute[73079]:     </system>
Aug 17 14:49:14 user nova-compute[73079]:   </sysinfo>
Aug 17 14:49:14 user nova-compute[73079]:   <os>
Aug 17 14:49:14 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:49:14 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:49:14 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:49:14 user nova-compute[73079]:   </os>
Aug 17 14:49:14 user nova-compute[73079]:   <features>
Aug 17 14:49:14 user nova-compute[73079]:     <acpi/>
Aug 17 14:49:14 user nova-compute[73079]:     <apic/>
Aug 17 14:49:14 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:49:14 user nova-compute[73079]:   </features>
Aug 17 14:49:14 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:49:14 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:49:14 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:49:14 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:49:14 user nova-compute[73079]:   </clock>
Aug 17 14:49:14 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:49:14 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:49:14 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:49:14 user nova-compute[73079]:   </cpu>
Aug 17 14:49:14 user nova-compute[73079]:   <devices>
Aug 17 14:49:14 user nova-compute[73079]:     <disk type="file" device="cdrom">
Aug 17 14:49:14 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 14:49:14 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d/disk.config"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="hda" bus="ide"/>
Aug 17 14:49:14 user nova-compute[73079]:     </disk>
Aug 17 14:49:14 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:49:14 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:49:14 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <serial>98e3aadd-8b61-4a44-b7a8-7ebcc281313f</serial>
Aug 17 14:49:14 user nova-compute[73079]:     </disk>
Aug 17 14:49:14 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:49:14 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:49:14 user nova-compute[73079]:       <source dev="/dev/sde"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <serial>e642aadd-1c4e-4150-a11c-404642ef6b9c</serial>
Aug 17 14:49:14 user nova-compute[73079]:     </disk>
Aug 17 14:49:14 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:49:14 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:49:14 user nova-compute[73079]:       <source dev="/dev/sdd"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="vdc" bus="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <serial>daa3b5a8-4d51-4da9-b701-ab8012b76f63</serial>
Aug 17 14:49:14 user nova-compute[73079]:     </disk>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:32:35:5a"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tap8e7ad6a3-fd"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:0d:19:0d"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tapf6e4c3a8-05"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:20:ca:73"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tapf27e3ac4-e1"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:99:3a:18"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tap38516260-e2"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:f4:5d:bf"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tape801876f-84"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:fd:dc:75"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tap6522ab6c-71"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:49:14 user nova-compute[73079]:       <mac address="fa:16:3e:b2:74:a1"/>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:49:14 user nova-compute[73079]:       <target dev="tap6d86f32c-18"/>
Aug 17 14:49:14 user nova-compute[73079]:     </interface>
Aug 17 14:49:14 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:49:14 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d/console.log" append="off"/>
Aug 17 14:49:14 user nova-compute[73079]:     </serial>
Aug 17 14:49:14 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:49:14 user nova-compute[73079]:     <video>
Aug 17 14:49:14 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:49:14 user nova-compute[73079]:     </video>
Aug 17 14:49:14 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:49:14 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:49:14 user nova-compute[73079]:     </rng>
Aug 17 14:49:14 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:49:14 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:49:14 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:49:14 user nova-compute[73079]:     </memballoon>
Aug 17 14:49:14 user nova-compute[73079]:   </devices>
Aug 17 14:49:14 user nova-compute[73079]: </domain>
Aug 17 14:49:14 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e7ad6a3-fd, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e7ad6a3-fd, col_values=(('external_ids', {'iface-id': '8e7ad6a3-fd35-44cd-8295-912e199b872c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:35:5a', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6e4c3a8-05, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6e4c3a8-05, col_values=(('external_ids', {'iface-id': 'f6e4c3a8-0552-46cb-aa49-102881e833aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:19:0d', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf27e3ac4-e1, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf27e3ac4-e1, col_values=(('external_ids', {'iface-id': 'f27e3ac4-e193-4548-8b1c-5e40392ad172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ca:73', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38516260-e2, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38516260-e2, col_values=(('external_ids', {'iface-id': '38516260-e21b-433d-9794-cfad25c6c377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:3a:18', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape801876f-84, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape801876f-84, col_values=(('external_ids', {'iface-id': 'e801876f-843a-465b-86d6-3e90f64ef441', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:5d:bf', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6522ab6c-71, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6522ab6c-71, col_values=(('external_ids', {'iface-id': '6522ab6c-714a-495e-9eef-e57f249ed0cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:dc:75', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d86f32c-18, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d86f32c-18, col_values=(('external_ids', {'iface-id': '6d86f32c-18ab-4066-b086-7e2db728812a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:74:a1', 'vm-uuid': 'f9b2e33c-dfb8-45b9-94ed-02563cac358d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:14 user nova-compute[73079]: INFO os_vif [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18')
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] No BDM found with device name hda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] No VIF found with MAC fa:16:3e:32:35:5a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] No VIF found with MAC fa:16:3e:f4:5d:bf, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:49:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Using config drive
Aug 17 14:49:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Creating config drive at /opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d/disk.config
Aug 17 14:49:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcppptixn {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcppptixn" returned: 0 in 0.076s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-7b2b881b-aef8-4ed5-9bdd-6bd5141437f1 req-4354c138-b90d-46b8-81c4-d95b05bb8bf3 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7b2b881b-aef8-4ed5-9bdd-6bd5141437f1 req-4354c138-b90d-46b8-81c4-d95b05bb8bf3 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7b2b881b-aef8-4ed5-9bdd-6bd5141437f1 req-4354c138-b90d-46b8-81c4-d95b05bb8bf3 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7b2b881b-aef8-4ed5-9bdd-6bd5141437f1 req-4354c138-b90d-46b8-81c4-d95b05bb8bf3 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-7b2b881b-aef8-4ed5-9bdd-6bd5141437f1 req-4354c138-b90d-46b8-81c4-d95b05bb8bf3 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:16 user nova-compute[73079]: WARNING nova.compute.manager [req-7b2b881b-aef8-4ed5-9bdd-6bd5141437f1 req-4354c138-b90d-46b8-81c4-d95b05bb8bf3 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c for instance with vm_state building and task_state spawning.
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c8b3000-46b7-46d7-bbce-d6313c9d8f6e req-e3210cc1-b519-4b35-93ec-b213861e3348 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c8b3000-46b7-46d7-bbce-d6313c9d8f6e req-e3210cc1-b519-4b35-93ec-b213861e3348 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c8b3000-46b7-46d7-bbce-d6313c9d8f6e req-e3210cc1-b519-4b35-93ec-b213861e3348 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c8b3000-46b7-46d7-bbce-d6313c9d8f6e req-e3210cc1-b519-4b35-93ec-b213861e3348 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c8b3000-46b7-46d7-bbce-d6313c9d8f6e req-e3210cc1-b519-4b35-93ec-b213861e3348 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:17 user nova-compute[73079]: WARNING nova.compute.manager [req-3c8b3000-46b7-46d7-bbce-d6313c9d8f6e req-e3210cc1-b519-4b35-93ec-b213861e3348 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 for instance with vm_state building and task_state spawning.
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-bba220a0-1c3c-4d92-905f-db006b16428e req-b3ee4751-570c-469d-800d-3c1a2d8af976 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bba220a0-1c3c-4d92-905f-db006b16428e req-b3ee4751-570c-469d-800d-3c1a2d8af976 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bba220a0-1c3c-4d92-905f-db006b16428e req-b3ee4751-570c-469d-800d-3c1a2d8af976 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bba220a0-1c3c-4d92-905f-db006b16428e req-b3ee4751-570c-469d-800d-3c1a2d8af976 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-bba220a0-1c3c-4d92-905f-db006b16428e req-b3ee4751-570c-469d-800d-3c1a2d8af976 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:17 user nova-compute[73079]: WARNING nova.compute.manager [req-bba220a0-1c3c-4d92-905f-db006b16428e req-b3ee4751-570c-469d-800d-3c1a2d8af976 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 for instance with vm_state building and task_state spawning.
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283742.768149, a2c17473-d65d-4a2b-8382-ac868705c232 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:17 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] VM Stopped (Lifecycle Event)
Aug 17 14:49:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0401f234-7162-4ceb-a1e3-99a306f59d82 None None] [instance: a2c17473-d65d-4a2b-8382-ac868705c232] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-f6e4c3a8-0552-46cb-aa49-102881e833aa for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-f6e4c3a8-0552-46cb-aa49-102881e833aa {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-f6e4c3a8-0552-46cb-aa49-102881e833aa for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:18 user nova-compute[73079]: WARNING nova.compute.manager [req-26d6589d-b1b2-494c-834e-34f36505c13e req-4fc4348d-00b5-4a33-a153-b43a72d5665d service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc for instance with vm_state building and task_state spawning.
Aug 17 14:49:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:19 user nova-compute[73079]: WARNING nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 for instance with vm_state building and task_state spawning.
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:19 user nova-compute[73079]: WARNING nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a for instance with vm_state building and task_state spawning.
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:19 user nova-compute[73079]: WARNING nova.compute.manager [req-f59363fb-0bec-4eff-a7a6-a7a6ace6507f req-ab1d336c-f324-4e6e-935a-a4e49203aca8 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a for instance with vm_state building and task_state spawning.
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-51de6de3-abfd-46b9-8d3d-14e449d16fc3 req-94fe11cd-7005-4550-b3c0-e6a828309ee9 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51de6de3-abfd-46b9-8d3d-14e449d16fc3 req-94fe11cd-7005-4550-b3c0-e6a828309ee9 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51de6de3-abfd-46b9-8d3d-14e449d16fc3 req-94fe11cd-7005-4550-b3c0-e6a828309ee9 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51de6de3-abfd-46b9-8d3d-14e449d16fc3 req-94fe11cd-7005-4550-b3c0-e6a828309ee9 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-51de6de3-abfd-46b9-8d3d-14e449d16fc3 req-94fe11cd-7005-4550-b3c0-e6a828309ee9 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:19 user nova-compute[73079]: WARNING nova.compute.manager [req-51de6de3-abfd-46b9-8d3d-14e449d16fc3 req-94fe11cd-7005-4550-b3c0-e6a828309ee9 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 for instance with vm_state building and task_state spawning.
Aug 17 14:49:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance spawned successfully.
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283760.227918, f9b2e33c-dfb8-45b9-94ed-02563cac358d => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] VM Resumed (Lifecycle Event)
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283760.2283938, f9b2e33c-dfb8-45b9-94ed-02563cac358d => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] VM Started (Lifecycle Event)
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Took 10.78 seconds to spawn the instance on the hypervisor.
Aug 17 14:49:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Shelve offloading
Aug 17 14:49:20 user nova-compute[73079]: INFO nova.compute.manager [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Took 49.66 seconds to build instance.
Aug 17 14:49:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dfd05b91-8b86-4c33-9aa8-c609647bd952 tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.811s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:21 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance destroyed successfully.
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-unplugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] No waiting events found dispatching network-vif-unplugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:21 user nova-compute[73079]: WARNING nova.compute.manager [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received unexpected event network-vif-unplugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 for instance with vm_state active and task_state shelving.
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] No waiting events found dispatching network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:21 user nova-compute[73079]: WARNING nova.compute.manager [req-df4c9efd-5b06-47f7-8834-222a238c7340 req-6b84c2ce-faa3-4760-b3b2-7f467cd4897c service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received unexpected event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 for instance with vm_state active and task_state shelving.
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing instance network info cache due to event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:49:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updated VIF entry in instance network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-05a28660-a6db-4ea9-bf3b-4cc26b0c10b7 req-9d77db1b-7c9c-4aaa-8b1b-8a0a14e45a59 service nova] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:49:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance destroyed successfully.
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'resources' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2034968715',display_name='tempest-TestShelveInstance-server-2034968715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2034968715',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbGklE/wIZHfre7/KNRyaOYhfx9Ub85b5BHkSuHI78cUei5tmdmA06ZzGd6VV3OrmVHzGwMAwituwDPQcNVFrxlKVO53+m+KaPpwVtFoir5ymc3bkR/Cqvhak6QwxrdwA==',key_name='tempest-TestShelveInstance-844004364',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54af3e289d9e4aa1bc8f1c93716310dd',ramdisk_id='',reservation_id='r-kz120ti7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-341194626',owner_user_name='tempest-TestShelveInstance-341194626-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:47:45Z,user_data=None,user_id='d28228aad23b4fceaa2c672075af526c',uuid=4c729310-f0a9-4faf-ab22-02c440738a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converting VIF {"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_vif [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4569de50-d6, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing instance network info cache due to event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:49:22 user nova-compute[73079]: INFO os_vif [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6')
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:49:22 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e77963-59d2-4f00-a38c-33a051e61906]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64870436-3b07-4047-b94b-43d6b4603445]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:22 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:22 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:22 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:49:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:49:22 user nova-compute[73079]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:49:22 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:49:22 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:49:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c84e23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804e11f-9c25-42c8-a654-ade0a3da09c8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[875e7514-443d-4625-9cda-7c34a19a4893]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33027a56-0df8-4d05-a2bf-a965b6cbef07]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e3f64-5e94-4897-b6be-3d346f4176bf]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed586d-b1ae-43ab-a4a1-84889cea43ee]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda23e1-8c8e-4b21-bade-d40a73ef3f96]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]
Aug 17 14:49:22 user nova-compute[73079]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.
Aug 17 14:49:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae216a9-f0cb-4909-a083-d97d292eb4bf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] <== disconnect_volume: return (318ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:49:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Deleting instance files /opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43_del
Aug 17 14:49:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Deletion of /opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43_del complete
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updated VIF entry in instance network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": null, "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4569de50-d6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:49:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a9420f7a-5a42-423f-9a0a-c9b281847cde req-627222a7-f69d-43be-be7c-abcc08ceb2e0 service nova] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:49:23 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Deleted allocations for instance 4c729310-f0a9-4faf-ab22-02c440738a43
Aug 17 14:49:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:49:23 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:49:23 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:49:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c79f1908-d61d-4419-94f2-7f97df101e66 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.634s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:26 user nova-compute[73079]: INFO nova.compute.manager [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Terminating instance
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Instance destroyed successfully.
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lazy-loading 'resources' on Instance uuid e9d53810-409d-41d6-bae3-b30937b21b25 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-f85e8c5f-5b91-4df7-a8b5-d353ec7517ef req-d628251d-34c6-4b4c-82b4-b6f3d15e2496 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-unplugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f85e8c5f-5b91-4df7-a8b5-d353ec7517ef req-d628251d-34c6-4b4c-82b4-b6f3d15e2496 service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f85e8c5f-5b91-4df7-a8b5-d353ec7517ef req-d628251d-34c6-4b4c-82b4-b6f3d15e2496 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f85e8c5f-5b91-4df7-a8b5-d353ec7517ef req-d628251d-34c6-4b4c-82b4-b6f3d15e2496 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-f85e8c5f-5b91-4df7-a8b5-d353ec7517ef req-d628251d-34c6-4b4c-82b4-b6f3d15e2496 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-unplugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-f85e8c5f-5b91-4df7-a8b5-d353ec7517ef req-d628251d-34c6-4b4c-82b4-b6f3d15e2496 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-unplugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2062491303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2062491303',id=15,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL96ole8PPg9PLCFfphR6VQ6SCxsJTc4mGT4ezft9mXPjTBpXk6cWYKW3TMs1cIWgs+s1i9rLWwgeXO+0rq4uU8/akzE+Zt1R/nNYyt8KerO4XP8Scuvakar0+ieSgkGMg==',key_name='tempest-keypair-803134676',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47957ef1019a4623ac6bf81921f1619d',ramdisk_id='',reservation_id='r-zpa85udh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487335572',owner_user_name='tempest-TaggedAttachmentsTest-1487335572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:46:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cea43fd4553b425b85b6eb25a066055d',uuid=e9d53810-409d-41d6-bae3-b30937b21b25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converting VIF {"id": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "address": "fa:16:3e:40:bc:c2", "network": {"id": "2e901b18-27a6-476f-9400-fa3a14638f76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1503319765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47957ef1019a4623ac6bf81921f1619d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ece65d3-f2", "ovs_interfaceid": "1ece65d3-f2d3-4e2d-999c-e91c5d08441f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG os_vif [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ece65d3-f2, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:49:26 user nova-compute[73079]: INFO os_vif [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:bc:c2,bridge_name='br-int',has_traffic_filtering=True,id=1ece65d3-f2d3-4e2d-999c-e91c5d08441f,network=Network(2e901b18-27a6-476f-9400-fa3a14638f76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ece65d3-f2')
Aug 17 14:49:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Deleting instance files /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25_del
Aug 17 14:49:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Deletion of /opt/stack/data/nova/instances/e9d53810-409d-41d6-bae3-b30937b21b25_del complete
Aug 17 14:49:26 user nova-compute[73079]: INFO nova.compute.manager [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 17 14:49:26 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:49:26 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:49:27 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:49:27 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Took 1.02 seconds to deallocate network for instance.
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:28 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Deleted allocations for instance e9d53810-409d-41d6-bae3-b30937b21b25
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0330b462-50e0-4775-91d8-5cd4a7a2c649 tempest-TaggedAttachmentsTest-1487335572 tempest-TaggedAttachmentsTest-1487335572-project-member] Lock "e9d53810-409d-41d6-bae3-b30937b21b25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] Acquiring lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] Lock "e9d53810-409d-41d6-bae3-b30937b21b25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:49:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] No waiting events found dispatching network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:49:28 user nova-compute[73079]: WARNING nova.compute.manager [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received unexpected event network-vif-plugged-1ece65d3-f2d3-4e2d-999c-e91c5d08441f for instance with vm_state deleted and task_state None.
Aug 17 14:49:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-3f11cb1c-6f98-47fe-bb37-234a03933ff5 req-c5c169c8-3f84-4a2f-a32c-bb7e30ba70b7 service nova] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Received event network-vif-deleted-1ece65d3-f2d3-4e2d-999c-e91c5d08441f {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:49:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:36 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283761.2053623, 4c729310-f0a9-4faf-ab22-02c440738a43 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:36 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] VM Stopped (Lifecycle Event)
Aug 17 14:49:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff1f0e00-2447-49a9-8c90-06b18a59a061 None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:41 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283766.8153005, e9d53810-409d-41d6-bae3-b30937b21b25 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:49:41 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] VM Stopped (Lifecycle Event)
Aug 17 14:49:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-002230a3-d037-4b04-bf99-72e486e5b329 None None] [instance: e9d53810-409d-41d6-bae3-b30937b21b25] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:49:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:49:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:00 user nova-compute[73079]: INFO nova.compute.manager [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Terminating instance
Aug 17 14:50:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ca8d6140-d06d-424d-98f4-7229f43a6680 req-fd46ad35-2eb3-48cf-b178-7644afea5231 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ca8d6140-d06d-424d-98f4-7229f43a6680 req-fd46ad35-2eb3-48cf-b178-7644afea5231 service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ca8d6140-d06d-424d-98f4-7229f43a6680 req-fd46ad35-2eb3-48cf-b178-7644afea5231 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ca8d6140-d06d-424d-98f4-7229f43a6680 req-fd46ad35-2eb3-48cf-b178-7644afea5231 service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ca8d6140-d06d-424d-98f4-7229f43a6680 req-fd46ad35-2eb3-48cf-b178-7644afea5231 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-ca8d6140-d06d-424d-98f4-7229f43a6680 req-fd46ad35-2eb3-48cf-b178-7644afea5231 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-unplugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Instance destroyed successfully.
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'resources' on Instance uuid 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:40:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-433840162',display_name='tempest-AttachVolumeTestJSON-server-433840162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-433840162',id=5,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDb4VWCejmvDdAiWqfS/UGUBawsCgbinN61EsR+drp60j4NJl7P6xcnEnXaNmAc6N7CLlKK2cY4/yF07v6UqdYoBpWOYaPoSr0YUQfK9+JPuOHNos1fsLoiU/mWvgvGWQ==',key_name='tempest-keypair-724073608',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-c4693xw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "address": "fa:16:3e:44:20:b7", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88abdc44-49", "ovs_interfaceid": "88abdc44-4987-4e42-aac5-80b85b07fa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG os_vif [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88abdc44-49, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:50:01 user nova-compute[73079]: INFO os_vif [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:20:b7,bridge_name='br-int',has_traffic_filtering=True,id=88abdc44-4987-4e42-aac5-80b85b07fa9e,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88abdc44-49')
Aug 17 14:50:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Deleting instance files /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a_del
Aug 17 14:50:01 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Deletion of /opt/stack/data/nova/instances/259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a_del complete
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:01 user nova-compute[73079]: INFO nova.compute.manager [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Terminating instance
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:50:01 user nova-compute[73079]: INFO nova.compute.manager [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 14:50:01 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-2e15beff-9045-40a1-9293-b51fc92a38f1 req-d0d57203-2cfa-4df3-a273-8725b1e73f97 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-unplugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2e15beff-9045-40a1-9293-b51fc92a38f1 req-d0d57203-2cfa-4df3-a273-8725b1e73f97 service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2e15beff-9045-40a1-9293-b51fc92a38f1 req-d0d57203-2cfa-4df3-a273-8725b1e73f97 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2e15beff-9045-40a1-9293-b51fc92a38f1 req-d0d57203-2cfa-4df3-a273-8725b1e73f97 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-2e15beff-9045-40a1-9293-b51fc92a38f1 req-d0d57203-2cfa-4df3-a273-8725b1e73f97 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-unplugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-2e15beff-9045-40a1-9293-b51fc92a38f1 req-d0d57203-2cfa-4df3-a273-8725b1e73f97 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-unplugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:50:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Instance destroyed successfully.
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'resources' on Instance uuid dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1662234110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1662234110',id=12,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEilashB2BPL+es6WZoI8bJdKCPPyqoAL9bLN6jMjig7DSRb+5ktF80nPIgKjR1+keFKd+VUCMuVzSbEmj0FdeA0GkPBJ8wiruIQMze7tZ3+8USog9SCui1puZNu/HxxnQ==',key_name='tempest-keypair-1562296241',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-ufol2uj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=dcef5f40-f1b3-4fcb-8875-c8e749fc63c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "38eb71bf-50d8-4510-930a-6060b894242d", "address": "fa:16:3e:a2:28:f2", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38eb71bf-50", "ovs_interfaceid": "38eb71bf-50d8-4510-930a-6060b894242d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG os_vif [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38eb71bf-50, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:02 user nova-compute[73079]: INFO os_vif [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:28:f2,bridge_name='br-int',has_traffic_filtering=True,id=38eb71bf-50d8-4510-930a-6060b894242d,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38eb71bf-50')
Aug 17 14:50:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Deleting instance files /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1_del
Aug 17 14:50:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Deletion of /opt/stack/data/nova/instances/dcef5f40-f1b3-4fcb-8875-c8e749fc63c1_del complete
Aug 17 14:50:02 user nova-compute[73079]: INFO nova.compute.manager [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:02 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Took 0.96 seconds to deallocate network for instance.
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-e0bd1380-dc0a-475c-a9b2-8946dd94e6a4 req-2b02ca18-c61c-4d01-b50e-deb4be339d18 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-deleted-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:02 user nova-compute[73079]: INFO nova.compute.manager [req-e0bd1380-dc0a-475c-a9b2-8946dd94e6a4 req-2b02ca18-c61c-4d01-b50e-deb4be339d18 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Neutron deleted interface 88abdc44-4987-4e42-aac5-80b85b07fa9e; detaching it from the instance and deleting it from the info cache
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.network.neutron [req-e0bd1380-dc0a-475c-a9b2-8946dd94e6a4 req-2b02ca18-c61c-4d01-b50e-deb4be339d18 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-e0bd1380-dc0a-475c-a9b2-8946dd94e6a4 req-2b02ca18-c61c-4d01-b50e-deb4be339d18 service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Detach interface failed, port_id=88abdc44-4987-4e42-aac5-80b85b07fa9e, reason: Instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:50:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:03 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Deleted allocations for instance 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5df28227-1943-4cad-81ac-6d243f6fb3f6 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-7f7a0b75-186b-4dff-90c2-cf8bc504f957 req-b3536125-959a-4e04-bc8e-f904336a27cb service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7f7a0b75-186b-4dff-90c2-cf8bc504f957 req-b3536125-959a-4e04-bc8e-f904336a27cb service nova] Acquiring lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7f7a0b75-186b-4dff-90c2-cf8bc504f957 req-b3536125-959a-4e04-bc8e-f904336a27cb service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7f7a0b75-186b-4dff-90c2-cf8bc504f957 req-b3536125-959a-4e04-bc8e-f904336a27cb service nova] Lock "259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-7f7a0b75-186b-4dff-90c2-cf8bc504f957 req-b3536125-959a-4e04-bc8e-f904336a27cb service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] No waiting events found dispatching network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:50:03 user nova-compute[73079]: WARNING nova.compute.manager [req-7f7a0b75-186b-4dff-90c2-cf8bc504f957 req-b3536125-959a-4e04-bc8e-f904336a27cb service nova] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Received unexpected event network-vif-plugged-88abdc44-4987-4e42-aac5-80b85b07fa9e for instance with vm_state deleted and task_state None.
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:03 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Took 0.87 seconds to deallocate network for instance.
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:03 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Deleted allocations for instance dcef5f40-f1b3-4fcb-8875-c8e749fc63c1
Aug 17 14:50:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f12a6b8d-9618-4cb3-a457-1131c4c914e9 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] Acquiring lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] Lock "dcef5f40-f1b3-4fcb-8875-c8e749fc63c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] No waiting events found dispatching network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:50:04 user nova-compute[73079]: WARNING nova.compute.manager [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received unexpected event network-vif-plugged-38eb71bf-50d8-4510-930a-6060b894242d for instance with vm_state deleted and task_state None.
Aug 17 14:50:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7d5628a-d086-4ba5-a057-f0841bb5a89e req-1b060fe4-540f-4dd3-9c6b-106db1a9aa66 service nova] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Received event network-vif-deleted-38eb71bf-50d8-4510-930a-6060b894242d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:50:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8345MB free_disk=25.73477554321289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance f9b2e33c-dfb8-45b9-94ed-02563cac358d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1bbf6615-32dd-41eb-a14c-685476f49c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:50:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:50:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 17 14:50:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:50:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:50:16 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283801.6410966, 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:50:16 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] VM Stopped (Lifecycle Event)
Aug 17 14:50:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-478af243-20aa-46dd-a12c-43480065f9a4 None None] [instance: 259c3ab8-8c2c-4f5b-9d5e-27d1e1f37f1a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:50:17 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283802.561234, dcef5f40-f1b3-4fcb-8875-c8e749fc63c1 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:50:17 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] VM Stopped (Lifecycle Event)
Aug 17 14:50:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d342c5eb-14f9-4709-aef6-dce9e7ac1b9b None None] [instance: dcef5f40-f1b3-4fcb-8875-c8e749fc63c1] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:50:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-changed-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Refreshing instance network info cache due to event network-changed-abb92137-be34-4f1d-b0d4-72f3ba157584. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:50:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] Acquiring lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:50:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] Acquired lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:50:35 user nova-compute[73079]: DEBUG nova.network.neutron [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Refreshing network info cache for port abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:50:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updated VIF entry in instance network info cache for port abb92137-be34-4f1d-b0d4-72f3ba157584. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:50:36 user nova-compute[73079]: DEBUG nova.network.neutron [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updating instance_info_cache with network_info: [{"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ed295a4f-239a-4340-b469-eeed6474ac52 req-4a51e2a2-1d75-482a-9fac-f0f13443fc0d service nova] Releasing lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:50:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.219s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:40 user nova-compute[73079]: INFO nova.compute.manager [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Attaching volume 4aa6e2e9-15ed-4d96-994d-fc6879369429 to /dev/vdb
Aug 17 14:50:40 user nova-compute[73079]: DEBUG os_brick.utils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a4d2a-c4c6-43be-8bfd-bc4285934e2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce47a3e-d43b-4caa-941c-d285f83a509f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5d40a1-bc88-4b21-8da3-eb73a54e16d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a55a9a-a6a7-49e0-9f24-d5a17fedb3dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:50:40 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:50:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a2cad-2e99-440e-8510-8515a577e161]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG os_brick.utils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:50:40 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updating existing volume attachment record: 9ff3c794-c04f-4a52-ba71-2cba5b45d1b6 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:50:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:50:46 user nova-compute[73079]: INFO nova.compute.claims [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Claim successful on node user
Aug 17 14:50:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:50:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.policy [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f67004af6654b5d80924a5c502a74f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd4ad5f2eb4e728a71908d32d353d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:50:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Creating image(s)
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk 1073741824" returned: 0 in 0.046s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Successfully created port: f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Cannot resize image /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'migration_context' on Instance uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Ensure instance console log exists: /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Successfully updated port: f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-changed-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Refreshing instance network info cache due to event network-changed-f1d8de62-fa52-4c8a-90c9-f147cababaae. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] Acquiring lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Instance network_info: |[{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] Acquired lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Refreshing network info cache for port f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Start _get_guest_xml network_info=[{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:50:48 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:50:48 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1972411876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1972411876',id=19,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-3ky599w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:50:47Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=cf693095-4aa8-4b88-b9bd-fe9026c71d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'pci_devices' on Instance uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:50:48 user nova-compute[73079]:   <uuid>cf693095-4aa8-4b88-b9bd-fe9026c71d28</uuid>
Aug 17 14:50:48 user nova-compute[73079]:   <name>instance-00000013</name>
Aug 17 14:50:48 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:50:48 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:50:48 user nova-compute[73079]:   <metadata>
Aug 17 14:50:48 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:50:48 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:50:48 user nova-compute[73079]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1972411876</nova:name>
Aug 17 14:50:48 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:50:48</nova:creationTime>
Aug 17 14:50:48 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:50:48 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:50:48 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:50:48 user nova-compute[73079]:       <nova:owner>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:user uuid="5f67004af6654b5d80924a5c502a74f2">tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member</nova:user>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:project uuid="0edd4ad5f2eb4e728a71908d32d353d5">tempest-ServerBootFromVolumeStableRescueTest-2072772980</nova:project>
Aug 17 14:50:48 user nova-compute[73079]:       </nova:owner>
Aug 17 14:50:48 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:50:48 user nova-compute[73079]:       <nova:ports>
Aug 17 14:50:48 user nova-compute[73079]:         <nova:port uuid="f1d8de62-fa52-4c8a-90c9-f147cababaae">
Aug 17 14:50:48 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 14:50:48 user nova-compute[73079]:         </nova:port>
Aug 17 14:50:48 user nova-compute[73079]:       </nova:ports>
Aug 17 14:50:48 user nova-compute[73079]:     </nova:instance>
Aug 17 14:50:48 user nova-compute[73079]:   </metadata>
Aug 17 14:50:48 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:50:48 user nova-compute[73079]:     <system>
Aug 17 14:50:48 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:50:48 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:50:48 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:50:48 user nova-compute[73079]:       <entry name="serial">cf693095-4aa8-4b88-b9bd-fe9026c71d28</entry>
Aug 17 14:50:48 user nova-compute[73079]:       <entry name="uuid">cf693095-4aa8-4b88-b9bd-fe9026c71d28</entry>
Aug 17 14:50:48 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:50:48 user nova-compute[73079]:     </system>
Aug 17 14:50:48 user nova-compute[73079]:   </sysinfo>
Aug 17 14:50:48 user nova-compute[73079]:   <os>
Aug 17 14:50:48 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:50:48 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:50:48 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:50:48 user nova-compute[73079]:   </os>
Aug 17 14:50:48 user nova-compute[73079]:   <features>
Aug 17 14:50:48 user nova-compute[73079]:     <acpi/>
Aug 17 14:50:48 user nova-compute[73079]:     <apic/>
Aug 17 14:50:48 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:50:48 user nova-compute[73079]:   </features>
Aug 17 14:50:48 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:50:48 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:50:48 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:50:48 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:50:48 user nova-compute[73079]:   </clock>
Aug 17 14:50:48 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:50:48 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:50:48 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:50:48 user nova-compute[73079]:   </cpu>
Aug 17 14:50:48 user nova-compute[73079]:   <devices>
Aug 17 14:50:48 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:50:48 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:50:48 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk"/>
Aug 17 14:50:48 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:50:48 user nova-compute[73079]:     </disk>
Aug 17 14:50:48 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:50:48 user nova-compute[73079]:       <mac address="fa:16:3e:c5:91:62"/>
Aug 17 14:50:48 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:50:48 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:50:48 user nova-compute[73079]:       <target dev="tapf1d8de62-fa"/>
Aug 17 14:50:48 user nova-compute[73079]:     </interface>
Aug 17 14:50:48 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:50:48 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/console.log" append="off"/>
Aug 17 14:50:48 user nova-compute[73079]:     </serial>
Aug 17 14:50:48 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:50:48 user nova-compute[73079]:     <video>
Aug 17 14:50:48 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:50:48 user nova-compute[73079]:     </video>
Aug 17 14:50:48 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:50:48 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:50:48 user nova-compute[73079]:     </rng>
Aug 17 14:50:48 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:50:48 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:50:48 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:50:48 user nova-compute[73079]:     </memballoon>
Aug 17 14:50:48 user nova-compute[73079]:   </devices>
Aug 17 14:50:48 user nova-compute[73079]: </domain>
Aug 17 14:50:48 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1972411876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1972411876',id=19,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-3ky599w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:50:47Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=cf693095-4aa8-4b88-b9bd-fe9026c71d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG os_vif [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1d8de62-fa, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1d8de62-fa, col_values=(('external_ids', {'iface-id': 'f1d8de62-fa52-4c8a-90c9-f147cababaae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:91:62', 'vm-uuid': 'cf693095-4aa8-4b88-b9bd-fe9026c71d28'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:48 user nova-compute[73079]: INFO os_vif [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa')
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:50:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No VIF found with MAC fa:16:3e:c5:91:62, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:50:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updated VIF entry in instance network info cache for port f1d8de62-fa52-4c8a-90c9-f147cababaae. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:50:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-21fb4c2e-3ecb-4b45-8b4f-bd62d957b184 req-c9e89793-40b4-4ca5-ad6e-6fd4c6720a77 service nova] Releasing lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-d867f203-3339-4c58-a2c1-9c2bb6cc4978 req-752136de-e95e-403b-aa1c-42684e8f7570 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d867f203-3339-4c58-a2c1-9c2bb6cc4978 req-752136de-e95e-403b-aa1c-42684e8f7570 service nova] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d867f203-3339-4c58-a2c1-9c2bb6cc4978 req-752136de-e95e-403b-aa1c-42684e8f7570 service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d867f203-3339-4c58-a2c1-9c2bb6cc4978 req-752136de-e95e-403b-aa1c-42684e8f7570 service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-d867f203-3339-4c58-a2c1-9c2bb6cc4978 req-752136de-e95e-403b-aa1c-42684e8f7570 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] No waiting events found dispatching network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:50:50 user nova-compute[73079]: WARNING nova.compute.manager [req-d867f203-3339-4c58-a2c1-9c2bb6cc4978 req-752136de-e95e-403b-aa1c-42684e8f7570 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received unexpected event network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae for instance with vm_state building and task_state spawning.
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRdgZTqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:50:52 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:50:52 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:50:52 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f8c078-f8f3-4804-9ac9-16d6b383f1c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:50:52 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51880fd-4028-4d8d-927b-b4ebfc716421]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429] added
Aug 17 14:50:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98d652-b3b9-448c-a8e1-135abef10ea3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b29797-8257-48ba-b467-eb58f48f6522]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRdgZTqP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRdgZTqP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c073057a-2de4-42e1-896c-5ae0310b7c13]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LRdgZTqP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0568e9d-b8a8-4d32-a450-325b9da8b988]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283852.3907664, cf693095-4aa8-4b88-b9bd-fe9026c71d28 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] VM Resumed (Lifecycle Event)
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Instance spawned successfully.
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521067a-66ff-4b74-9a67-9e5700cade2d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:50:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:50:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283852.3962197, cf693095-4aa8-4b88-b9bd-fe9026c71d28 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] VM Started (Lifecycle Event)
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadedfe-bde3-4cae-bf92-8f8fa78bc9ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260]
Aug 17 14:50:52 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260] successful.
Aug 17 14:50:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a5d1e-69ec-4261-9c9c-90542ca30f94]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Took 5.68 seconds to spawn the instance on the hypervisor.
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a1f4b4-ea2a-439a-88ce-18496e756b98]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:50:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:50:52 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:50:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efbdaa6-04f5-484a-8e19-6ceb381a8d7d]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRdgZTqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5df1dbd-488f-4188-9192-3c823002c9d9 req-5d9447af-547a-4365-845c-e1281dab9f03 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5df1dbd-488f-4188-9192-3c823002c9d9 req-5d9447af-547a-4365-845c-e1281dab9f03 service nova] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5df1dbd-488f-4188-9192-3c823002c9d9 req-5d9447af-547a-4365-845c-e1281dab9f03 service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5df1dbd-488f-4188-9192-3c823002c9d9 req-5d9447af-547a-4365-845c-e1281dab9f03 service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5df1dbd-488f-4188-9192-3c823002c9d9 req-5d9447af-547a-4365-845c-e1281dab9f03 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] No waiting events found dispatching network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:50:52 user nova-compute[73079]: WARNING nova.compute.manager [req-b5df1dbd-488f-4188-9192-3c823002c9d9 req-5d9447af-547a-4365-845c-e1281dab9f03 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received unexpected event network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae for instance with vm_state building and task_state spawning.
Aug 17 14:50:52 user nova-compute[73079]: INFO nova.compute.manager [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Took 6.27 seconds to build instance.
Aug 17 14:50:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ff94e38d-7631-4e18-9711-cf7c2e92941e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23233663866333163', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233663866333163', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:50:53 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:50:53 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:50:53 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:50:53 user nova-compute[73079]:   <serial>4aa6e2e9-15ed-4d96-994d-fc6879369429</serial>
Aug 17 14:50:53 user nova-compute[73079]: </disk>
Aug 17 14:50:53 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:50:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:50:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:50:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:04:fd:55, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:50:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41d79747-fea5-4e01-ba8e-30eaf1bc44cb tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.856s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:50:56 user nova-compute[73079]: INFO nova.compute.claims [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Claim successful on node user
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:50:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:50:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Creating image(s)
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "/opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "/opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "/opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG nova.policy [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e233ac54eb804ff0b6fdbf986a70dfe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3052ad0ca90d483284dd52edd3a79fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk 1073741824" returned: 0 in 0.057s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.205s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Cannot resize image /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'migration_context' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Ensure instance console log exists: /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:50:57 user nova-compute[73079]: INFO nova.compute.claims [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Claim successful on node user
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Successfully created port: 72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:50:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.policy [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb1feccca7d645ac90dff8f481bfe139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb0da7dcf51b4267a38083a278e58ef9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:50:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Creating image(s)
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.218s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk 1073741824" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Successfully updated port: 72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquired lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-changed-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Refreshing instance network info cache due to event network-changed-72a82218-b019-41c8-a988-4c37a5e8d134. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] Acquiring lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Cannot resize image /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'migration_context' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Ensure instance console log exists: /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updating instance_info_cache with network_info: [{"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Releasing lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Instance network_info: |[{"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] Acquired lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Refreshing network info cache for port 72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Start _get_guest_xml network_info=[{"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:50:59 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:50:59 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1388930478',display_name='tempest-AttachVolumeTestJSON-server-1388930478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1388930478',id=20,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYEU0/eATPMIAMVffb7Fg+AwxgjLE+Fgv+c5pu+SKeyuavIQR/xLFH3e3FsZhdN39DgQsfUZMtPO+cBQrZ5ZhI0hitTs+JEuxruCd3Uu9gHvOGS4a4IXSJItXj91NMpAA==',key_name='tempest-keypair-575381693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-1rcrrpjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=30babe22-af5d-486e-b29b-d82aa03b070d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'pci_devices' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:50:59 user nova-compute[73079]:   <uuid>30babe22-af5d-486e-b29b-d82aa03b070d</uuid>
Aug 17 14:50:59 user nova-compute[73079]:   <name>instance-00000014</name>
Aug 17 14:50:59 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:50:59 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:50:59 user nova-compute[73079]:   <metadata>
Aug 17 14:50:59 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:50:59 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:50:59 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeTestJSON-server-1388930478</nova:name>
Aug 17 14:50:59 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:50:59</nova:creationTime>
Aug 17 14:50:59 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:50:59 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:50:59 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:50:59 user nova-compute[73079]:       <nova:owner>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:user uuid="e233ac54eb804ff0b6fdbf986a70dfe8">tempest-AttachVolumeTestJSON-831896009-project-member</nova:user>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:project uuid="3052ad0ca90d483284dd52edd3a79fbe">tempest-AttachVolumeTestJSON-831896009</nova:project>
Aug 17 14:50:59 user nova-compute[73079]:       </nova:owner>
Aug 17 14:50:59 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:50:59 user nova-compute[73079]:       <nova:ports>
Aug 17 14:50:59 user nova-compute[73079]:         <nova:port uuid="72a82218-b019-41c8-a988-4c37a5e8d134">
Aug 17 14:50:59 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:50:59 user nova-compute[73079]:         </nova:port>
Aug 17 14:50:59 user nova-compute[73079]:       </nova:ports>
Aug 17 14:50:59 user nova-compute[73079]:     </nova:instance>
Aug 17 14:50:59 user nova-compute[73079]:   </metadata>
Aug 17 14:50:59 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:50:59 user nova-compute[73079]:     <system>
Aug 17 14:50:59 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:50:59 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:50:59 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:50:59 user nova-compute[73079]:       <entry name="serial">30babe22-af5d-486e-b29b-d82aa03b070d</entry>
Aug 17 14:50:59 user nova-compute[73079]:       <entry name="uuid">30babe22-af5d-486e-b29b-d82aa03b070d</entry>
Aug 17 14:50:59 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:50:59 user nova-compute[73079]:     </system>
Aug 17 14:50:59 user nova-compute[73079]:   </sysinfo>
Aug 17 14:50:59 user nova-compute[73079]:   <os>
Aug 17 14:50:59 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:50:59 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:50:59 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:50:59 user nova-compute[73079]:   </os>
Aug 17 14:50:59 user nova-compute[73079]:   <features>
Aug 17 14:50:59 user nova-compute[73079]:     <acpi/>
Aug 17 14:50:59 user nova-compute[73079]:     <apic/>
Aug 17 14:50:59 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:50:59 user nova-compute[73079]:   </features>
Aug 17 14:50:59 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:50:59 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:50:59 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:50:59 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:50:59 user nova-compute[73079]:   </clock>
Aug 17 14:50:59 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:50:59 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:50:59 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:50:59 user nova-compute[73079]:   </cpu>
Aug 17 14:50:59 user nova-compute[73079]:   <devices>
Aug 17 14:50:59 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:50:59 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:50:59 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk"/>
Aug 17 14:50:59 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:50:59 user nova-compute[73079]:     </disk>
Aug 17 14:50:59 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:50:59 user nova-compute[73079]:       <mac address="fa:16:3e:b8:fa:77"/>
Aug 17 14:50:59 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:50:59 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:50:59 user nova-compute[73079]:       <target dev="tap72a82218-b0"/>
Aug 17 14:50:59 user nova-compute[73079]:     </interface>
Aug 17 14:50:59 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:50:59 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/console.log" append="off"/>
Aug 17 14:50:59 user nova-compute[73079]:     </serial>
Aug 17 14:50:59 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:50:59 user nova-compute[73079]:     <video>
Aug 17 14:50:59 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:50:59 user nova-compute[73079]:     </video>
Aug 17 14:50:59 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:50:59 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:50:59 user nova-compute[73079]:     </rng>
Aug 17 14:50:59 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:50:59 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:50:59 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:50:59 user nova-compute[73079]:     </memballoon>
Aug 17 14:50:59 user nova-compute[73079]:   </devices>
Aug 17 14:50:59 user nova-compute[73079]: </domain>
Aug 17 14:50:59 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1388930478',display_name='tempest-AttachVolumeTestJSON-server-1388930478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1388930478',id=20,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYEU0/eATPMIAMVffb7Fg+AwxgjLE+Fgv+c5pu+SKeyuavIQR/xLFH3e3FsZhdN39DgQsfUZMtPO+cBQrZ5ZhI0hitTs+JEuxruCd3Uu9gHvOGS4a4IXSJItXj91NMpAA==',key_name='tempest-keypair-575381693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-1rcrrpjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=30babe22-af5d-486e-b29b-d82aa03b070d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG os_vif [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:50:59 user nova-compute[73079]: INFO nova.compute.claims [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Claim successful on node user
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a82218-b0, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72a82218-b0, col_values=(('external_ids', {'iface-id': '72a82218-b019-41c8-a988-4c37a5e8d134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:fa:77', 'vm-uuid': '30babe22-af5d-486e-b29b-d82aa03b070d'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:50:59 user nova-compute[73079]: INFO os_vif [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0')
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No VIF found with MAC fa:16:3e:b8:fa:77, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Successfully created port: e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:50:59 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updated VIF entry in instance network info cache for port 72a82218-b019-41c8-a988-4c37a5e8d134. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updating instance_info_cache with network_info: [{"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cf65b059-8f63-495c-b8be-f2f5ab348b21 req-f7969d1a-7172-4a62-80bb-0b6ca522213a service nova] Releasing lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:51:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.policy [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7edb85ca3cd14d4587b951327e892bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac38bd75ed4e588b516582286bfb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:51:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Creating image(s)
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "/opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk 1073741824" returned: 0 in 0.056s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:51:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Cannot resize image /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'migration_context' on Instance uuid 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Ensure instance console log exists: /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Successfully created port: 0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Successfully updated port: e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing instance network info cache due to event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-bb0f5f44-7b4f-4191-aef3-79eb8b3c0d8f req-fe325ff1-adec-45af-8923-5e6a6a7df659 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bb0f5f44-7b4f-4191-aef3-79eb8b3c0d8f req-fe325ff1-adec-45af-8923-5e6a6a7df659 service nova] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bb0f5f44-7b4f-4191-aef3-79eb8b3c0d8f req-fe325ff1-adec-45af-8923-5e6a6a7df659 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bb0f5f44-7b4f-4191-aef3-79eb8b3c0d8f req-fe325ff1-adec-45af-8923-5e6a6a7df659 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.compute.manager [req-bb0f5f44-7b4f-4191-aef3-79eb8b3c0d8f req-fe325ff1-adec-45af-8923-5e6a6a7df659 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] No waiting events found dispatching network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:01 user nova-compute[73079]: WARNING nova.compute.manager [req-bb0f5f44-7b4f-4191-aef3-79eb8b3c0d8f req-fe325ff1-adec-45af-8923-5e6a6a7df659 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received unexpected event network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 for instance with vm_state building and task_state spawning.
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance network_info: |[{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.neutron [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Start _get_guest_xml network_info=[{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:51:01 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:01 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133672793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133672793',id=21,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARxs6R8GIWvCZaN27p04AKhZgUrXAz57K69xG6NJf9Q+kTa+6hilQRHmRPIa8CWGAITlhUfltflCBV22ywZcLP1Wl7eawRO05FCEuBq/7UWL1tBdCJeGScBFR0Fa7SS6w==',key_name='tempest-keypair-756591381',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-a1wbitbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=d1f17d9d-7ffb-4b15-abdb-39c9b979118c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.objects.instance [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'pci_devices' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:51:01 user nova-compute[73079]:   <uuid>d1f17d9d-7ffb-4b15-abdb-39c9b979118c</uuid>
Aug 17 14:51:01 user nova-compute[73079]:   <name>instance-00000015</name>
Aug 17 14:51:01 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:51:01 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:51:01 user nova-compute[73079]:   <metadata>
Aug 17 14:51:01 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:51:01 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:51:01 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-133672793</nova:name>
Aug 17 14:51:01 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:51:01</nova:creationTime>
Aug 17 14:51:01 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:51:01 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:51:01 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:51:01 user nova-compute[73079]:       <nova:owner>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:user uuid="bb1feccca7d645ac90dff8f481bfe139">tempest-AttachVolumeShelveTestJSON-474259075-project-member</nova:user>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:project uuid="eb0da7dcf51b4267a38083a278e58ef9">tempest-AttachVolumeShelveTestJSON-474259075</nova:project>
Aug 17 14:51:01 user nova-compute[73079]:       </nova:owner>
Aug 17 14:51:01 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:51:01 user nova-compute[73079]:       <nova:ports>
Aug 17 14:51:01 user nova-compute[73079]:         <nova:port uuid="e242a398-9deb-40de-bf4d-ff67ed34bba9">
Aug 17 14:51:01 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 14:51:01 user nova-compute[73079]:         </nova:port>
Aug 17 14:51:01 user nova-compute[73079]:       </nova:ports>
Aug 17 14:51:01 user nova-compute[73079]:     </nova:instance>
Aug 17 14:51:01 user nova-compute[73079]:   </metadata>
Aug 17 14:51:01 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:51:01 user nova-compute[73079]:     <system>
Aug 17 14:51:01 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:51:01 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:51:01 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:51:01 user nova-compute[73079]:       <entry name="serial">d1f17d9d-7ffb-4b15-abdb-39c9b979118c</entry>
Aug 17 14:51:01 user nova-compute[73079]:       <entry name="uuid">d1f17d9d-7ffb-4b15-abdb-39c9b979118c</entry>
Aug 17 14:51:01 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:51:01 user nova-compute[73079]:     </system>
Aug 17 14:51:01 user nova-compute[73079]:   </sysinfo>
Aug 17 14:51:01 user nova-compute[73079]:   <os>
Aug 17 14:51:01 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:51:01 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:51:01 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:51:01 user nova-compute[73079]:   </os>
Aug 17 14:51:01 user nova-compute[73079]:   <features>
Aug 17 14:51:01 user nova-compute[73079]:     <acpi/>
Aug 17 14:51:01 user nova-compute[73079]:     <apic/>
Aug 17 14:51:01 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:51:01 user nova-compute[73079]:   </features>
Aug 17 14:51:01 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:51:01 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:51:01 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:51:01 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:51:01 user nova-compute[73079]:   </clock>
Aug 17 14:51:01 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:51:01 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:51:01 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:51:01 user nova-compute[73079]:   </cpu>
Aug 17 14:51:01 user nova-compute[73079]:   <devices>
Aug 17 14:51:01 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:51:01 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:51:01 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk"/>
Aug 17 14:51:01 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:51:01 user nova-compute[73079]:     </disk>
Aug 17 14:51:01 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:51:01 user nova-compute[73079]:       <mac address="fa:16:3e:be:9e:75"/>
Aug 17 14:51:01 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:51:01 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:51:01 user nova-compute[73079]:       <target dev="tape242a398-9d"/>
Aug 17 14:51:01 user nova-compute[73079]:     </interface>
Aug 17 14:51:01 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:51:01 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/console.log" append="off"/>
Aug 17 14:51:01 user nova-compute[73079]:     </serial>
Aug 17 14:51:01 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:51:01 user nova-compute[73079]:     <video>
Aug 17 14:51:01 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:51:01 user nova-compute[73079]:     </video>
Aug 17 14:51:01 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:51:01 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:51:01 user nova-compute[73079]:     </rng>
Aug 17 14:51:01 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:51:01 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:51:01 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:51:01 user nova-compute[73079]:     </memballoon>
Aug 17 14:51:01 user nova-compute[73079]:   </devices>
Aug 17 14:51:01 user nova-compute[73079]: </domain>
Aug 17 14:51:01 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133672793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133672793',id=21,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARxs6R8GIWvCZaN27p04AKhZgUrXAz57K69xG6NJf9Q+kTa+6hilQRHmRPIa8CWGAITlhUfltflCBV22ywZcLP1Wl7eawRO05FCEuBq/7UWL1tBdCJeGScBFR0Fa7SS6w==',key_name='tempest-keypair-756591381',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-a1wbitbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=d1f17d9d-7ffb-4b15-abdb-39c9b979118c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG os_vif [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape242a398-9d, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape242a398-9d, col_values=(('external_ids', {'iface-id': 'e242a398-9deb-40de-bf4d-ff67ed34bba9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:9e:75', 'vm-uuid': 'd1f17d9d-7ffb-4b15-abdb-39c9b979118c'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:01 user nova-compute[73079]: INFO os_vif [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d')
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No VIF found with MAC fa:16:3e:be:9e:75, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Successfully updated port: 0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquired lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updated VIF entry in instance network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d9e919e9-57ca-470b-b1da-e0bd7328bbe9 req-5dae1813-c459-4b04-8393-9478117781c9 service nova] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-changed-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Refreshing instance network info cache due to event network-changed-0de94324-c5b6-4ca4-94da-663e06760b81. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] Acquiring lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Updating instance_info_cache with network_info: [{"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Releasing lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Instance network_info: |[{"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] Acquired lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.neutron [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Refreshing network info cache for port 0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Start _get_guest_xml network_info=[{"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:51:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2016125783',display_name='tempest-AttachVolumeNegativeTest-server-2016125783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2016125783',id=22,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET7RhR25QcpLVKFRzaQPJ3r+XmthehoyD7BrEBM3sEe1OTxGIsmdgRdTvJNeQs3iUvJRz2b+7oqZr4DKfWiD0s17QsPhsd2h67ciY0heuFrPzMUetHUBWpxOc5xzjmUbA==',key_name='tempest-keypair-2003400962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-dq60osx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:51:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=58f0e1c8-d58a-4478-aeb2-d1d42df3e984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'pci_devices' on Instance uuid 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:51:02 user nova-compute[73079]:   <uuid>58f0e1c8-d58a-4478-aeb2-d1d42df3e984</uuid>
Aug 17 14:51:02 user nova-compute[73079]:   <name>instance-00000016</name>
Aug 17 14:51:02 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:51:02 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:51:02 user nova-compute[73079]:   <metadata>
Aug 17 14:51:02 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:51:02 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:51:02 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2016125783</nova:name>
Aug 17 14:51:02 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:51:02</nova:creationTime>
Aug 17 14:51:02 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:51:02 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:51:02 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:51:02 user nova-compute[73079]:       <nova:owner>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:user uuid="7edb85ca3cd14d4587b951327e892bd6">tempest-AttachVolumeNegativeTest-706656920-project-member</nova:user>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:project uuid="04ac38bd75ed4e588b516582286bfb97">tempest-AttachVolumeNegativeTest-706656920</nova:project>
Aug 17 14:51:02 user nova-compute[73079]:       </nova:owner>
Aug 17 14:51:02 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:51:02 user nova-compute[73079]:       <nova:ports>
Aug 17 14:51:02 user nova-compute[73079]:         <nova:port uuid="0de94324-c5b6-4ca4-94da-663e06760b81">
Aug 17 14:51:02 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 14:51:02 user nova-compute[73079]:         </nova:port>
Aug 17 14:51:02 user nova-compute[73079]:       </nova:ports>
Aug 17 14:51:02 user nova-compute[73079]:     </nova:instance>
Aug 17 14:51:02 user nova-compute[73079]:   </metadata>
Aug 17 14:51:02 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:51:02 user nova-compute[73079]:     <system>
Aug 17 14:51:02 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:51:02 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:51:02 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:51:02 user nova-compute[73079]:       <entry name="serial">58f0e1c8-d58a-4478-aeb2-d1d42df3e984</entry>
Aug 17 14:51:02 user nova-compute[73079]:       <entry name="uuid">58f0e1c8-d58a-4478-aeb2-d1d42df3e984</entry>
Aug 17 14:51:02 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:51:02 user nova-compute[73079]:     </system>
Aug 17 14:51:02 user nova-compute[73079]:   </sysinfo>
Aug 17 14:51:02 user nova-compute[73079]:   <os>
Aug 17 14:51:02 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:51:02 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:51:02 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:51:02 user nova-compute[73079]:   </os>
Aug 17 14:51:02 user nova-compute[73079]:   <features>
Aug 17 14:51:02 user nova-compute[73079]:     <acpi/>
Aug 17 14:51:02 user nova-compute[73079]:     <apic/>
Aug 17 14:51:02 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:51:02 user nova-compute[73079]:   </features>
Aug 17 14:51:02 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:51:02 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:51:02 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:51:02 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:51:02 user nova-compute[73079]:   </clock>
Aug 17 14:51:02 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:51:02 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:51:02 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:51:02 user nova-compute[73079]:   </cpu>
Aug 17 14:51:02 user nova-compute[73079]:   <devices>
Aug 17 14:51:02 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:51:02 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:51:02 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk"/>
Aug 17 14:51:02 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:51:02 user nova-compute[73079]:     </disk>
Aug 17 14:51:02 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:51:02 user nova-compute[73079]:       <mac address="fa:16:3e:3a:2d:93"/>
Aug 17 14:51:02 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:51:02 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:51:02 user nova-compute[73079]:       <target dev="tap0de94324-c5"/>
Aug 17 14:51:02 user nova-compute[73079]:     </interface>
Aug 17 14:51:02 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:51:02 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/console.log" append="off"/>
Aug 17 14:51:02 user nova-compute[73079]:     </serial>
Aug 17 14:51:02 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:51:02 user nova-compute[73079]:     <video>
Aug 17 14:51:02 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:51:02 user nova-compute[73079]:     </video>
Aug 17 14:51:02 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:51:02 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:51:02 user nova-compute[73079]:     </rng>
Aug 17 14:51:02 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:51:02 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:51:02 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:51:02 user nova-compute[73079]:     </memballoon>
Aug 17 14:51:02 user nova-compute[73079]:   </devices>
Aug 17 14:51:02 user nova-compute[73079]: </domain>
Aug 17 14:51:02 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2016125783',display_name='tempest-AttachVolumeNegativeTest-server-2016125783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2016125783',id=22,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET7RhR25QcpLVKFRzaQPJ3r+XmthehoyD7BrEBM3sEe1OTxGIsmdgRdTvJNeQs3iUvJRz2b+7oqZr4DKfWiD0s17QsPhsd2h67ciY0heuFrPzMUetHUBWpxOc5xzjmUbA==',key_name='tempest-keypair-2003400962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-dq60osx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:51:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=58f0e1c8-d58a-4478-aeb2-d1d42df3e984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG os_vif [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0de94324-c5, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0de94324-c5, col_values=(('external_ids', {'iface-id': '0de94324-c5b6-4ca4-94da-663e06760b81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:2d:93', 'vm-uuid': '58f0e1c8-d58a-4478-aeb2-d1d42df3e984'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:02 user nova-compute[73079]: INFO os_vif [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5')
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:51:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:3a:2d:93, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.network.neutron [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Updated VIF entry in instance network info cache for port 0de94324-c5b6-4ca4-94da-663e06760b81. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.network.neutron [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Updating instance_info_cache with network_info: [{"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-093e0968-e37a-4c60-a5bc-d88aee3878a8 req-4aa9eee8-1c12-465f-90fb-fa5f34a8824a service nova] Releasing lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283863.5967975, 30babe22-af5d-486e-b29b-d82aa03b070d => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] VM Resumed (Lifecycle Event)
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Instance spawned successfully.
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283863.5982225, 30babe22-af5d-486e-b29b-d82aa03b070d => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] VM Started (Lifecycle Event)
Aug 17 14:51:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Took 7.12 seconds to spawn the instance on the hypervisor.
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad8d46ea-9f2a-4e42-9098-43219902bb67 req-d1af81dd-0fbe-4318-98d5-42579df7a9d0 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad8d46ea-9f2a-4e42-9098-43219902bb67 req-d1af81dd-0fbe-4318-98d5-42579df7a9d0 service nova] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad8d46ea-9f2a-4e42-9098-43219902bb67 req-d1af81dd-0fbe-4318-98d5-42579df7a9d0 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad8d46ea-9f2a-4e42-9098-43219902bb67 req-d1af81dd-0fbe-4318-98d5-42579df7a9d0 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad8d46ea-9f2a-4e42-9098-43219902bb67 req-d1af81dd-0fbe-4318-98d5-42579df7a9d0 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] No waiting events found dispatching network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:03 user nova-compute[73079]: WARNING nova.compute.manager [req-ad8d46ea-9f2a-4e42-9098-43219902bb67 req-d1af81dd-0fbe-4318-98d5-42579df7a9d0 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received unexpected event network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 for instance with vm_state building and task_state spawning.
Aug 17 14:51:03 user nova-compute[73079]: INFO nova.compute.manager [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Took 7.92 seconds to build instance.
Aug 17 14:51:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f469d3db-f366-4a62-8704-b5ba911ed4f1 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.028s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-1f4f67eb-6a95-4217-888c-c79cd1764faa req-0e0b60ff-f520-4cc6-b719-45bc053da4da service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1f4f67eb-6a95-4217-888c-c79cd1764faa req-0e0b60ff-f520-4cc6-b719-45bc053da4da service nova] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1f4f67eb-6a95-4217-888c-c79cd1764faa req-0e0b60ff-f520-4cc6-b719-45bc053da4da service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1f4f67eb-6a95-4217-888c-c79cd1764faa req-0e0b60ff-f520-4cc6-b719-45bc053da4da service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-1f4f67eb-6a95-4217-888c-c79cd1764faa req-0e0b60ff-f520-4cc6-b719-45bc053da4da service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] No waiting events found dispatching network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:05 user nova-compute[73079]: WARNING nova.compute.manager [req-1f4f67eb-6a95-4217-888c-c79cd1764faa req-0e0b60ff-f520-4cc6-b719-45bc053da4da service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received unexpected event network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 for instance with vm_state building and task_state spawning.
Aug 17 14:51:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:06 user nova-compute[73079]: WARNING nova.compute.manager [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state building and task_state spawning.
Aug 17 14:51:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:06 user nova-compute[73079]: WARNING nova.compute.manager [req-2c53f247-7e38-48a9-acb2-453df46865fa req-d5a7f83e-af12-420b-9865-83563e49763c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state building and task_state spawning.
Aug 17 14:51:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-08cb978e-ee5f-45d9-83bc-264d9839239f req-f7c51103-5f9b-405a-ac2d-837fe5178114 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-08cb978e-ee5f-45d9-83bc-264d9839239f req-f7c51103-5f9b-405a-ac2d-837fe5178114 service nova] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-08cb978e-ee5f-45d9-83bc-264d9839239f req-f7c51103-5f9b-405a-ac2d-837fe5178114 service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-08cb978e-ee5f-45d9-83bc-264d9839239f req-f7c51103-5f9b-405a-ac2d-837fe5178114 service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-08cb978e-ee5f-45d9-83bc-264d9839239f req-f7c51103-5f9b-405a-ac2d-837fe5178114 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] No waiting events found dispatching network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:07 user nova-compute[73079]: WARNING nova.compute.manager [req-08cb978e-ee5f-45d9-83bc-264d9839239f req-f7c51103-5f9b-405a-ac2d-837fe5178114 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received unexpected event network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 for instance with vm_state building and task_state spawning.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283867.627788, d1f17d9d-7ffb-4b15-abdb-39c9b979118c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] VM Resumed (Lifecycle Event)
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance spawned successfully.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283867.6330788, d1f17d9d-7ffb-4b15-abdb-39c9b979118c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] VM Started (Lifecycle Event)
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Took 9.31 seconds to spawn the instance on the hypervisor.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283867.8187327, 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] VM Resumed (Lifecycle Event)
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Instance spawned successfully.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Took 10.08 seconds to build instance.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-38bbec54-e7f7-41e6-acd9-9b3d0d9d6b76 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.204s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283867.821781, 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] VM Started (Lifecycle Event)
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:07 user nova-compute[73079]: INFO nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Took 7.67 seconds to spawn the instance on the hypervisor.
Aug 17 14:51:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:08 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:08 user nova-compute[73079]: INFO nova.compute.manager [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Took 8.50 seconds to build instance.
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6ad2e5b4-a20f-49c9-b067-86b5e89651b8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.609s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:11 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:11 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=25.690174102783203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:51:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance f9b2e33c-dfb8-45b9-94ed-02563cac358d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1bbf6615-32dd-41eb-a14c-685476f49c5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 30babe22-af5d-486e-b29b-d82aa03b070d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance d1f17d9d-7ffb-4b15-abdb-39c9b979118c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-changed-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing instance network info cache due to event network-changed-8e7ad6a3-fd35-44cd-8295-912e199b872c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.network.neutron [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Refreshing network info cache for port 8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating resource provider dea4593c-fa71-4579-88eb-51499faa7caf generation from 28 to 29 during operation: update_aggregates {{(pid=73079) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:12 user nova-compute[73079]: INFO nova.compute.manager [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Unshelving
Aug 17 14:51:12 user nova-compute[73079]: INFO nova.virt.block_device [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Booting with volume b0d28c05-99d0-4909-883b-11dceff37a41 at /dev/vda
Aug 17 14:51:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG os_brick.utils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e3b5f-02f0-4a8c-878f-53102fc83bda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf48908-a4e9-423c-882f-950ddb1df5f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5406462a-3336-4197-a4ea-9fec25d13806]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec209b04-10c3-465a-a2ec-6857fad97aa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:51:12 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a1777d-582d-4f13-92b6-5eba83817cec]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG os_brick.utils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating existing volume attachment record: bc8a677f-b55d-4d49-b5be-db64bdca999f {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.159s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG nova.network.neutron [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updated VIF entry in instance network info cache for port 8e7ad6a3-fd35-44cd-8295-912e199b872c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG nova.network.neutron [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7b69cf53-e7f3-4a91-be39-6dbe2a5a721c req-12131f1e-b3d8-406b-9cae-ec30141af68f service nova] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:51:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:51:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:51:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid f9b2e33c-dfb8-45b9-94ed-02563cac358d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:15 user nova-compute[73079]: INFO nova.compute.manager [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Terminating instance
Aug 17 14:51:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-554249d5-fb5c-4cae-8527-3c17a3fda1a5 req-f0878f52-040d-4bf7-b310-f78d72adc1cf service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-554249d5-fb5c-4cae-8527-3c17a3fda1a5 req-f0878f52-040d-4bf7-b310-f78d72adc1cf service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-554249d5-fb5c-4cae-8527-3c17a3fda1a5 req-f0878f52-040d-4bf7-b310-f78d72adc1cf service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-554249d5-fb5c-4cae-8527-3c17a3fda1a5 req-f0878f52-040d-4bf7-b310-f78d72adc1cf service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-554249d5-fb5c-4cae-8527-3c17a3fda1a5 req-f0878f52-040d-4bf7-b310-f78d72adc1cf service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-unplugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-554249d5-fb5c-4cae-8527-3c17a3fda1a5 req-f0878f52-040d-4bf7-b310-f78d72adc1cf service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-88192f9c-689d-4136-a508-5e3d31aea996 req-38a1ed1a-d7a0-4cef-864a-96af0b1e9f44 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-88192f9c-689d-4136-a508-5e3d31aea996 req-38a1ed1a-d7a0-4cef-864a-96af0b1e9f44 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-88192f9c-689d-4136-a508-5e3d31aea996 req-38a1ed1a-d7a0-4cef-864a-96af0b1e9f44 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-88192f9c-689d-4136-a508-5e3d31aea996 req-38a1ed1a-d7a0-4cef-864a-96af0b1e9f44 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-88192f9c-689d-4136-a508-5e3d31aea996 req-38a1ed1a-d7a0-4cef-864a-96af0b1e9f44 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-unplugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-88192f9c-689d-4136-a508-5e3d31aea996 req-38a1ed1a-d7a0-4cef-864a-96af0b1e9f44 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-38516260-e21b-433d-9794-cfad25c6c377 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:51:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Instance destroyed successfully.
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lazy-loading 'resources' on Instance uuid f9b2e33c-dfb8-45b9-94ed-02563cac358d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e7ad6a3-fd, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:35:5a,bridge_name='br-int',has_traffic_filtering=True,id=8e7ad6a3-fd35-44cd-8295-912e199b872c,network=Network(33f0e9b8-a5dc-41ef-9470-41741c119019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7ad6a3-fd')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6e4c3a8-05, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:19:0d,bridge_name='br-int',has_traffic_filtering=True,id=f6e4c3a8-0552-46cb-aa49-102881e833aa,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf6e4c3a8-05')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf27e3ac4-e1, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:73,bridge_name='br-int',has_traffic_filtering=True,id=f27e3ac4-e193-4548-8b1c-5e40392ad172,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf27e3ac4-e1')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38516260-e2, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:3a:18,bridge_name='br-int',has_traffic_filtering=True,id=38516260-e21b-433d-9794-cfad25c6c377,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38516260-e2')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape801876f-84, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:5d:bf,bridge_name='br-int',has_traffic_filtering=True,id=e801876f-843a-465b-86d6-3e90f64ef441,network=Network(29bc227a-ec2f-46ad-baec-3b1287db8394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape801876f-84')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6522ab6c-71, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:dc:75,bridge_name='br-int',has_traffic_filtering=True,id=6522ab6c-714a-495e-9eef-e57f249ed0cc,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6522ab6c-71')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82034825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82034825',id=17,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWobYXFPXM8ONlRYqgEr0NkkZM7nLTMoPmVjKQ4herfLwJSiS3gJRJ+7loxQM4mOhR5Dvj7EBMSkGXKIZlR1LmaafQtbf+zoIdjTMdHjh6ZwUMHgTf0GGZhXdg/hXfXLQ==',key_name='tempest-keypair-417317572',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfe62d7ce38d45b2b8ed21a331aa7cd4',ramdisk_id='',reservation_id='r-q3qnkdzk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1175207045',owner_user_name='tempest-TaggedBootDevicesTest-1175207045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6178e46fa30a4646bf886fbd84aefe7d',uuid=f9b2e33c-dfb8-45b9-94ed-02563cac358d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converting VIF {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d86f32c-18, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:18 user nova-compute[73079]: INFO os_vif [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:74:a1,bridge_name='br-int',has_traffic_filtering=True,id=6d86f32c-18ab-4066-b086-7e2db728812a,network=Network(317de9af-e75c-4eaa-8408-a76309c64a36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d86f32c-18')
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fOhbjdBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:51:18 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-72404438-2d47-4137-9fbc-c8023d051d87 req-40597bb5-1480-447a-9d0d-5c07ae70f170 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72404438-2d47-4137-9fbc-c8023d051d87 req-40597bb5-1480-447a-9d0d-5c07ae70f170 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72404438-2d47-4137-9fbc-c8023d051d87 req-40597bb5-1480-447a-9d0d-5c07ae70f170 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72404438-2d47-4137-9fbc-c8023d051d87 req-40597bb5-1480-447a-9d0d-5c07ae70f170 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-72404438-2d47-4137-9fbc-c8023d051d87 req-40597bb5-1480-447a-9d0d-5c07ae70f170 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:18 user nova-compute[73079]: WARNING nova.compute.manager [req-72404438-2d47-4137-9fbc-c8023d051d87 req-40597bb5-1480-447a-9d0d-5c07ae70f170 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-f27e3ac4-e193-4548-8b1c-5e40392ad172 for instance with vm_state active and task_state deleting.
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[65211578-f46a-49b9-bdbe-690e904c3754]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "address": "fa:16:3e:32:35:5a", "network": {"id": "33f0e9b8-a5dc-41ef-9470-41741c119019", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-638874139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7ad6a3-fd", "ovs_interfaceid": "8e7ad6a3-fd35-44cd-8295-912e199b872c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2708cf1-54c6-4308-9182-6802d151c78d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:51:18 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:51:18 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:51:18 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f (non-flash)
Aug 17 14:51:18 user nova-compute[73079]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:51:18 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:51:18 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f796f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-f9b2e33c-dfb8-45b9-94ed-02563cac358d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:51:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5b2ef-0c84-4048-9fdf-81365c48f04e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ac217-21af-4023-9d8a-b2ae1b3daf75]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[382b33d2-385b-4aec-9d9e-e516863d59af]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8df4ea-da36-4427-9454-5df5ae062e8e]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb33cc-7480-4335-94e1-4a8b10b2eafc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[88053737-83a1-4591-aead-abe7d5efbe94]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260]
Aug 17 14:51:19 user nova-compute[73079]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f, portal: 172.16.0.220,3260] successful.
Aug 17 14:51:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e3aadd-8b61-4a44-b7a8-7ebcc281313f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[36449675-7f1c-43ad-af10-b843f3db440d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== disconnect_volume: return (492ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMVRQXlk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:51:19 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[78806c30-af40-40f6-baad-eae70203dcb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7ae5f7-ea73-49d6-8046-f67427e27014]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:51:19 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c (non-flash)
Aug 17 14:51:19 user nova-compute[73079]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f77b16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e7d2f3-cc8f-4f0f-8c02-0bb23276b697]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d83fd-8faa-44f2-9ccc-872748014376]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4203475-e2a5-4a8b-9e71-4f984ea864e4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a87cd-ac40-48a2-b150-53d801ea44da]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a410b29-fe8f-46f7-9dce-48e8dfc342ee]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee61271-ec88-4bd5-bc7d-4b3f58abd095]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260]
Aug 17 14:51:19 user nova-compute[73079]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c, portal: 172.16.0.220,3260] successful.
Aug 17 14:51:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e642aadd-1c4e-4150-a11c-404642ef6b9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f869586-86cf-4fa8-babd-d75ee977640e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== disconnect_volume: return (407ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyoDpMEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:51:19 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:19 user nova-compute[73079]: WARNING nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-38516260-e21b-433d-9794-cfad25c6c377 for instance with vm_state active and task_state deleting.
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-unplugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-6d86f32c-18ab-4066-b086-7e2db728812a for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:19 user nova-compute[73079]: WARNING nova.compute.manager [req-360497e2-bd45-43b6-aa4a-bb3ce3af4504 req-cbf7ff92-74f3-4945-946e-3a2c6e8c5a99 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-6d86f32c-18ab-4066-b086-7e2db728812a for instance with vm_state active and task_state deleting.
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a83e8-92ae-42a3-a551-2820cb5b14a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47b9041-1317-4e1b-8933-a200dc84f596]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e83de830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc5ab1d-2a58-43cc-be2e-1c7b7b8e6912]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d1e96f-b9f0-4254-b3e0-27c2f3a7d978]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3407314-fa7b-44cb-9e18-17679b4a6048]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2499e704-b1f8-4941-bc62-4a6adf69e9a3]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:51:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6baded-490b-47ee-9148-e67b69a7f4c8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f1f11-4134-4dd2-a628-6a286cbb54df]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260]
Aug 17 14:51:20 user nova-compute[73079]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63, portal: 172.16.0.220,3260] successful.
Aug 17 14:51:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa3b5a8-4d51-4da9-b701-ab8012b76f63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad8306-5dd7-462f-abf4-1edfbca9b969]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] <== disconnect_volume: return (363ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:51:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Deleting instance files /opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d_del
Aug 17 14:51:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Deletion of /opt/stack/data/nova/instances/f9b2e33c-dfb8-45b9-94ed-02563cac358d_del complete
Aug 17 14:51:20 user nova-compute[73079]: INFO nova.compute.manager [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Took 4.28 seconds to destroy the instance on the hypervisor.
Aug 17 14:51:20 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:51:20 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:51:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-d4432142-669d-4bad-8ec8-aee91e218a9f req-f23ab5b6-19d9-412f-a775-4aa388c54aa4 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d4432142-669d-4bad-8ec8-aee91e218a9f req-f23ab5b6-19d9-412f-a775-4aa388c54aa4 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d4432142-669d-4bad-8ec8-aee91e218a9f req-f23ab5b6-19d9-412f-a775-4aa388c54aa4 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d4432142-669d-4bad-8ec8-aee91e218a9f req-f23ab5b6-19d9-412f-a775-4aa388c54aa4 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-d4432142-669d-4bad-8ec8-aee91e218a9f req-f23ab5b6-19d9-412f-a775-4aa388c54aa4 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-unplugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-d4432142-669d-4bad-8ec8-aee91e218a9f req-f23ab5b6-19d9-412f-a775-4aa388c54aa4 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-8e7ad6a3-fd35-44cd-8295-912e199b872c for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:51:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:24 user nova-compute[73079]: WARNING nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-8e7ad6a3-fd35-44cd-8295-912e199b872c for instance with vm_state active and task_state deleting.
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-unplugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-unplugged-e801876f-843a-465b-86d6-3e90f64ef441 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-deleted-8e7ad6a3-fd35-44cd-8295-912e199b872c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:24 user nova-compute[73079]: INFO nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Neutron deleted interface 8e7ad6a3-fd35-44cd-8295-912e199b872c; detaching it from the instance and deleting it from the info cache
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.network.neutron [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [{"id": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "address": "fa:16:3e:0d:19:0d", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6e4c3a8-05", "ovs_interfaceid": "f6e4c3a8-0552-46cb-aa49-102881e833aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "address": "fa:16:3e:20:ca:73", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf27e3ac4-e1", "ovs_interfaceid": "f27e3ac4-e193-4548-8b1c-5e40392ad172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38516260-e21b-433d-9794-cfad25c6c377", "address": "fa:16:3e:99:3a:18", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38516260-e2", "ovs_interfaceid": "38516260-e21b-433d-9794-cfad25c6c377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e801876f-843a-465b-86d6-3e90f64ef441", "address": "fa:16:3e:f4:5d:bf", "network": {"id": "29bc227a-ec2f-46ad-baec-3b1287db8394", "bridge": "br-int", "label": "tempest-device-tagging-net1-1509118763", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape801876f-84", "ovs_interfaceid": "e801876f-843a-465b-86d6-3e90f64ef441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "address": "fa:16:3e:fd:dc:75", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6522ab6c-71", "ovs_interfaceid": "6522ab6c-714a-495e-9eef-e57f249ed0cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d86f32c-18ab-4066-b086-7e2db728812a", "address": "fa:16:3e:b2:74:a1", "network": {"id": "317de9af-e75c-4eaa-8408-a76309c64a36", "bridge": "br-int", "label": "tempest-device-tagging-net2-486594120", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfe62d7ce38d45b2b8ed21a331aa7cd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d86f32c-18", "ovs_interfaceid": "6d86f32c-18ab-4066-b086-7e2db728812a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Detach interface failed, port_id=8e7ad6a3-fd35-44cd-8295-912e199b872c, reason: Instance f9b2e33c-dfb8-45b9-94ed-02563cac358d could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:24 user nova-compute[73079]: WARNING nova.compute.manager [req-7a2613ff-68d0-476c-85af-690bd09fce68 req-2ff9aa32-554c-47db-b907-ead0d93d061b service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-e801876f-843a-465b-86d6-3e90f64ef441 for instance with vm_state active and task_state deleting.
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:26 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Took 5.88 seconds to deallocate network for instance.
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] Acquiring lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] No waiting events found dispatching network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:26 user nova-compute[73079]: WARNING nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received unexpected event network-vif-plugged-6522ab6c-714a-495e-9eef-e57f249ed0cc for instance with vm_state active and task_state deleting.
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-deleted-6522ab6c-714a-495e-9eef-e57f249ed0cc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-deleted-e801876f-843a-465b-86d6-3e90f64ef441 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-deleted-6d86f32c-18ab-4066-b086-7e2db728812a {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1ba64e-4b4d-40d0-8a7b-2cc393c12c63 req-7b5b577a-df26-4ccf-a1f5-b6a943b43f91 service nova] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Received event network-vif-deleted-38516260-e21b-433d-9794-cfad25c6c377 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'pci_requests' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:27 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:51:27 user nova-compute[73079]: INFO nova.compute.claims [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Claim successful on node user
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:28 user nova-compute[73079]: INFO nova.network.neutron [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating port 4569de50-d6e2-4623-8b72-c2f9a25a4279 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 14:51:28 user nova-compute[73079]: INFO nova.compute.manager [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Took 2.40 seconds to detach 3 volumes for instance.
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:51:28 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Deleted allocations for instance f9b2e33c-dfb8-45b9-94ed-02563cac358d
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing instance network info cache due to event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-36a4a45e-5dd4-4513-b361-7d1d9cf31c3c tempest-TaggedBootDevicesTest-1175207045 tempest-TaggedBootDevicesTest-1175207045-project-member] Lock "f9b2e33c-dfb8-45b9-94ed-02563cac358d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.995s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:51:29 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Creating image(s)
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Ensure instance console log exists: /opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Start _get_guest_xml network_info=[{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'bc8a677f-b55d-4d49-b5be-db64bdca999f', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c729310-f0a9-4faf-ab22-02c440738a43', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0d28c05-99d0-4909-883b-11dceff37a41', 'serial': 'b0d28c05-99d0-4909-883b-11dceff37a41'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.network.neutron [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:51:29 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:29 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:51:29 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:51:29 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:51:29 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c726f65-8dd8-423e-abbf-03ba4699ee7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:51:29 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bf36cd-dd0d-4daa-951f-1b6e79bbccf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41] added
Aug 17 14:51:29 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[910f5397-5ed7-4733-a6fd-dc39d8fd9be4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ccacd-30bb-418f-a721-c9f0ad1c358f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReNqmEwT {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReNqmEwT" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e12642-13f3-4ffc-99df-86100021b9a3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReNqmEwT'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f6a06-3251-4366-b738-e74e13c006cf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[79219a50-fb56-417f-805a-700b049a8ab9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[42912814-70ce-485c-834f-e509e762ea62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]
Aug 17 14:51:30 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.
Aug 17 14:51:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1e979-bd1d-48ce-88ea-7af889ebe57b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d7a6c6-8d40-461c-84af-117cc6db88d2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:30 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:51:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:51:30 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:51:30 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[871f973d-2d08-4514-ba56-68820a78d403]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updated VIF entry in instance network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-07bfb2d8-2126-4faf-a54c-18a5d390eb9f req-1976bf62-c696-4269-ba68-7f76989661ee service nova] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23335623535393037', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335623535393037', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2034968715',display_name='tempest-TestShelveInstance-server-2034968715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2034968715',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-844004364',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='54af3e289d9e4aa1bc8f1c93716310dd',ramdisk_id='',reservation_id='r-kz120ti7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-341194626',owner_user_name='tempest-TestShelveInstance-341194626-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:51:13Z,user_data=None,user_id='d28228aad23b4fceaa2c672075af526c',uuid=4c729310-f0a9-4faf-ab22-02c440738a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converting VIF {"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:51:31 user nova-compute[73079]:   <uuid>4c729310-f0a9-4faf-ab22-02c440738a43</uuid>
Aug 17 14:51:31 user nova-compute[73079]:   <name>instance-00000010</name>
Aug 17 14:51:31 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:51:31 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:51:31 user nova-compute[73079]:   <metadata>
Aug 17 14:51:31 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:51:31 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:51:31 user nova-compute[73079]:       <nova:name>tempest-TestShelveInstance-server-2034968715</nova:name>
Aug 17 14:51:31 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:51:29</nova:creationTime>
Aug 17 14:51:31 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:51:31 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:51:31 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:51:31 user nova-compute[73079]:       <nova:owner>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:user uuid="d28228aad23b4fceaa2c672075af526c">tempest-TestShelveInstance-341194626-project-member</nova:user>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:project uuid="54af3e289d9e4aa1bc8f1c93716310dd">tempest-TestShelveInstance-341194626</nova:project>
Aug 17 14:51:31 user nova-compute[73079]:       </nova:owner>
Aug 17 14:51:31 user nova-compute[73079]:       <nova:ports>
Aug 17 14:51:31 user nova-compute[73079]:         <nova:port uuid="4569de50-d6e2-4623-8b72-c2f9a25a4279">
Aug 17 14:51:31 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 14:51:31 user nova-compute[73079]:         </nova:port>
Aug 17 14:51:31 user nova-compute[73079]:       </nova:ports>
Aug 17 14:51:31 user nova-compute[73079]:     </nova:instance>
Aug 17 14:51:31 user nova-compute[73079]:   </metadata>
Aug 17 14:51:31 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:51:31 user nova-compute[73079]:     <system>
Aug 17 14:51:31 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:51:31 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:51:31 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:51:31 user nova-compute[73079]:       <entry name="serial">4c729310-f0a9-4faf-ab22-02c440738a43</entry>
Aug 17 14:51:31 user nova-compute[73079]:       <entry name="uuid">4c729310-f0a9-4faf-ab22-02c440738a43</entry>
Aug 17 14:51:31 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:51:31 user nova-compute[73079]:     </system>
Aug 17 14:51:31 user nova-compute[73079]:   </sysinfo>
Aug 17 14:51:31 user nova-compute[73079]:   <os>
Aug 17 14:51:31 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:51:31 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:51:31 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:51:31 user nova-compute[73079]:   </os>
Aug 17 14:51:31 user nova-compute[73079]:   <features>
Aug 17 14:51:31 user nova-compute[73079]:     <acpi/>
Aug 17 14:51:31 user nova-compute[73079]:     <apic/>
Aug 17 14:51:31 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:51:31 user nova-compute[73079]:   </features>
Aug 17 14:51:31 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:51:31 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:51:31 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:51:31 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:51:31 user nova-compute[73079]:   </clock>
Aug 17 14:51:31 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:51:31 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:51:31 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:51:31 user nova-compute[73079]:   </cpu>
Aug 17 14:51:31 user nova-compute[73079]:   <devices>
Aug 17 14:51:31 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:51:31 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:51:31 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 14:51:31 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:51:31 user nova-compute[73079]:       <serial>b0d28c05-99d0-4909-883b-11dceff37a41</serial>
Aug 17 14:51:31 user nova-compute[73079]:     </disk>
Aug 17 14:51:31 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:51:31 user nova-compute[73079]:       <mac address="fa:16:3e:e5:ac:71"/>
Aug 17 14:51:31 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:51:31 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:51:31 user nova-compute[73079]:       <target dev="tap4569de50-d6"/>
Aug 17 14:51:31 user nova-compute[73079]:     </interface>
Aug 17 14:51:31 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:51:31 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43/console.log" append="off"/>
Aug 17 14:51:31 user nova-compute[73079]:     </serial>
Aug 17 14:51:31 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:51:31 user nova-compute[73079]:     <video>
Aug 17 14:51:31 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:51:31 user nova-compute[73079]:     </video>
Aug 17 14:51:31 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:51:31 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:51:31 user nova-compute[73079]:     </rng>
Aug 17 14:51:31 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:51:31 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:51:31 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:51:31 user nova-compute[73079]:     </memballoon>
Aug 17 14:51:31 user nova-compute[73079]:   </devices>
Aug 17 14:51:31 user nova-compute[73079]: </domain>
Aug 17 14:51:31 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2034968715',display_name='tempest-TestShelveInstance-server-2034968715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2034968715',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-844004364',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='54af3e289d9e4aa1bc8f1c93716310dd',ramdisk_id='',reservation_id='r-kz120ti7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-341194626',owner_user_name='tempest-TestShelveInstance-341194626-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:51:13Z,user_data=None,user_id='d28228aad23b4fceaa2c672075af526c',uuid=4c729310-f0a9-4faf-ab22-02c440738a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converting VIF {"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG os_vif [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4569de50-d6, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4569de50-d6, col_values=(('external_ids', {'iface-id': '4569de50-d6e2-4623-8b72-c2f9a25a4279', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:ac:71', 'vm-uuid': '4c729310-f0a9-4faf-ab22-02c440738a43'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:31 user nova-compute[73079]: INFO os_vif [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6')
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] No VIF found with MAC fa:16:3e:e5:ac:71, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:51:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-51ab6d33-20d3-4618-8cf6-63183ff16abc req-d157486c-fa7c-4373-9908-23b5b6292cf8 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51ab6d33-20d3-4618-8cf6-63183ff16abc req-d157486c-fa7c-4373-9908-23b5b6292cf8 service nova] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51ab6d33-20d3-4618-8cf6-63183ff16abc req-d157486c-fa7c-4373-9908-23b5b6292cf8 service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51ab6d33-20d3-4618-8cf6-63183ff16abc req-d157486c-fa7c-4373-9908-23b5b6292cf8 service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-51ab6d33-20d3-4618-8cf6-63183ff16abc req-d157486c-fa7c-4373-9908-23b5b6292cf8 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] No waiting events found dispatching network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:32 user nova-compute[73079]: WARNING nova.compute.manager [req-51ab6d33-20d3-4618-8cf6-63183ff16abc req-d157486c-fa7c-4373-9908-23b5b6292cf8 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received unexpected event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 14:51:33 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283878.2305055, f9b2e33c-dfb8-45b9-94ed-02563cac358d => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:33 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] VM Stopped (Lifecycle Event)
Aug 17 14:51:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-62b7123b-3680-44ff-8ea0-5d4122de99d1 None None] [instance: f9b2e33c-dfb8-45b9-94ed-02563cac358d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283894.835926, 4c729310-f0a9-4faf-ab22-02c440738a43 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] VM Resumed (Lifecycle Event)
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:51:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance spawned successfully.
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-0838436a-f7e7-4d19-b380-1f1d25dd0a86 req-a2f4919c-ba60-4044-940f-470d613aad75 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0838436a-f7e7-4d19-b380-1f1d25dd0a86 req-a2f4919c-ba60-4044-940f-470d613aad75 service nova] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0838436a-f7e7-4d19-b380-1f1d25dd0a86 req-a2f4919c-ba60-4044-940f-470d613aad75 service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0838436a-f7e7-4d19-b380-1f1d25dd0a86 req-a2f4919c-ba60-4044-940f-470d613aad75 service nova] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-0838436a-f7e7-4d19-b380-1f1d25dd0a86 req-a2f4919c-ba60-4044-940f-470d613aad75 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] No waiting events found dispatching network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:51:34 user nova-compute[73079]: WARNING nova.compute.manager [req-0838436a-f7e7-4d19-b380-1f1d25dd0a86 req-a2f4919c-ba60-4044-940f-470d613aad75 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received unexpected event network-vif-plugged-4569de50-d6e2-4623-8b72-c2f9a25a4279 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 14:51:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283894.840125, 4c729310-f0a9-4faf-ab22-02c440738a43 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:51:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] VM Started (Lifecycle Event)
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:51:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:51:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:51:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a916b6e-7b15-41cb-9036-aecb12425956 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.474s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:51:40 user nova-compute[73079]: INFO nova.compute.claims [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Claim successful on node user
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:51:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:51:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:51:41 user nova-compute[73079]: INFO nova.virt.block_device [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Booting with volume snapshot 11afcc4b-0499-4e19-8977-b43ae046779b at /dev/vda
Aug 17 14:51:41 user nova-compute[73079]: DEBUG nova.policy [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '722f38129c96487b8331cde0ab317832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9478b753e2040e799f28e18c5a82223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:51:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Successfully created port: d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:51:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Successfully updated port: d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "refresh_cache-67fcd60a-d9b7-45e3-b8df-56df69011831" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquired lock "refresh_cache-67fcd60a-d9b7-45e3-b8df-56df69011831" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-changed-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Refreshing instance network info cache due to event network-changed-d4449800-d6dc-4e62-a42f-75321633b2bb. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] Acquiring lock "refresh_cache-67fcd60a-d9b7-45e3-b8df-56df69011831" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Updating instance_info_cache with network_info: [{"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Releasing lock "refresh_cache-67fcd60a-d9b7-45e3-b8df-56df69011831" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Instance network_info: |[{"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] Acquired lock "refresh_cache-67fcd60a-d9b7-45e3-b8df-56df69011831" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:51:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Refreshing network info cache for port d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:51:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Updated VIF entry in instance network info cache for port d4449800-d6dc-4e62-a42f-75321633b2bb. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:51:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Updating instance_info_cache with network_info: [{"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:51:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-974a1e7b-7194-4e5a-a99e-16bc900df7f5 req-c90e6337-6c88-422d-af01-791d196963ae service nova] Releasing lock "refresh_cache-67fcd60a-d9b7-45e3-b8df-56df69011831" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG os_brick.utils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd646a7-d693-4d88-9559-1dafcd7f593b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2edc4d2-5622-4998-815b-94c3220880ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed126e-bb73-41fa-a5cf-4e6223f0ef80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a2b1ce-b9c3-46bd-a549-7e15ce643ec3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:51:46 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:51:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97f9c2-28c8-48f4-8047-fd1cacf9c9e0]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG os_brick.utils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:51:46 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Updating existing volume attachment record: acbf0f31-b5a8-408e-ba48-8d321fbbb80e {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:51:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:51:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:52:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Creating image(s)
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Ensure instance console log exists: /opt/stack/data/nova/instances/67fcd60a-d9b7-45e3-b8df-56df69011831/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Start _get_guest_xml network_info=[{"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'acbf0f31-b5a8-408e-ba48-8d321fbbb80e', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiAIuGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67fcd60a-d9b7-45e3-b8df-56df69011831', 'attached_at': '', 'detached_at': '', 'volume_id': '7500cafa-240a-46d6-9f7a-effc10e68b8e', 'serial': '7500cafa-240a-46d6-9f7a-effc10e68b8e'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:52:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:52:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiAIuGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:52:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:52:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:52:04 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf184ee-054d-45cd-9da3-aaa3f41361c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:52:04 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[415a0bbe-f6bc-456a-b6a9-61d6bcdc0f5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e] added
Aug 17 14:52:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca0ad7-9b88-49c2-b8f3-289c8d5616c6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[249271c2-a0aa-45d0-8aa0-89cac6564afd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPiAIuGn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPiAIuGn" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fe4e1-107f-4c4a-b471-b6582047c951]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPiAIuGn'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6545ea18-1d27-40f3-a0c3-c561ff8ac837]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101f1b7-9f46-4533-822e-1daa2ab3301d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[892b3e7a-d8ec-4dcc-aa3d-7699ccfa720d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260]
Aug 17 14:52:04 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260] successful.
Aug 17 14:52:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4f6bd-b5d7-4e27-94c2-a1c0ff4050b7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaf5659-cb82-48b7-977c-ba8a39c4d867]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:52:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:52:04 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:52:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af2040-fafe-4ce0-8429-9f9240c2f420]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiAIuGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23137366361396264', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137366361396264', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1543664065',display_name='tempest-TestVolumeBootPattern-server-1543664065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1543664065',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-8i3s5sw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:51:41Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=67fcd60a-d9b7-45e3-b8df-56df69011831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'pci_devices' on Instance uuid 67fcd60a-d9b7-45e3-b8df-56df69011831 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:52:05 user nova-compute[73079]:   <uuid>67fcd60a-d9b7-45e3-b8df-56df69011831</uuid>
Aug 17 14:52:05 user nova-compute[73079]:   <name>instance-00000017</name>
Aug 17 14:52:05 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:52:05 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:52:05 user nova-compute[73079]:   <metadata>
Aug 17 14:52:05 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:52:05 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:52:05 user nova-compute[73079]:       <nova:name>tempest-TestVolumeBootPattern-server-1543664065</nova:name>
Aug 17 14:52:05 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:52:04</nova:creationTime>
Aug 17 14:52:05 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:52:05 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:52:05 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:52:05 user nova-compute[73079]:       <nova:owner>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:user uuid="722f38129c96487b8331cde0ab317832">tempest-TestVolumeBootPattern-1112851866-project-member</nova:user>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:project uuid="c9478b753e2040e799f28e18c5a82223">tempest-TestVolumeBootPattern-1112851866</nova:project>
Aug 17 14:52:05 user nova-compute[73079]:       </nova:owner>
Aug 17 14:52:05 user nova-compute[73079]:       <nova:ports>
Aug 17 14:52:05 user nova-compute[73079]:         <nova:port uuid="d4449800-d6dc-4e62-a42f-75321633b2bb">
Aug 17 14:52:05 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 14:52:05 user nova-compute[73079]:         </nova:port>
Aug 17 14:52:05 user nova-compute[73079]:       </nova:ports>
Aug 17 14:52:05 user nova-compute[73079]:     </nova:instance>
Aug 17 14:52:05 user nova-compute[73079]:   </metadata>
Aug 17 14:52:05 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:52:05 user nova-compute[73079]:     <system>
Aug 17 14:52:05 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:52:05 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:52:05 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:52:05 user nova-compute[73079]:       <entry name="serial">67fcd60a-d9b7-45e3-b8df-56df69011831</entry>
Aug 17 14:52:05 user nova-compute[73079]:       <entry name="uuid">67fcd60a-d9b7-45e3-b8df-56df69011831</entry>
Aug 17 14:52:05 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:52:05 user nova-compute[73079]:     </system>
Aug 17 14:52:05 user nova-compute[73079]:   </sysinfo>
Aug 17 14:52:05 user nova-compute[73079]:   <os>
Aug 17 14:52:05 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:52:05 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:52:05 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:52:05 user nova-compute[73079]:   </os>
Aug 17 14:52:05 user nova-compute[73079]:   <features>
Aug 17 14:52:05 user nova-compute[73079]:     <acpi/>
Aug 17 14:52:05 user nova-compute[73079]:     <apic/>
Aug 17 14:52:05 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:52:05 user nova-compute[73079]:   </features>
Aug 17 14:52:05 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:52:05 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:52:05 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:52:05 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:52:05 user nova-compute[73079]:   </clock>
Aug 17 14:52:05 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:52:05 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:52:05 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:52:05 user nova-compute[73079]:   </cpu>
Aug 17 14:52:05 user nova-compute[73079]:   <devices>
Aug 17 14:52:05 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:52:05 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:52:05 user nova-compute[73079]:       <source dev="/dev/sdd"/>
Aug 17 14:52:05 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:52:05 user nova-compute[73079]:       <serial>7500cafa-240a-46d6-9f7a-effc10e68b8e</serial>
Aug 17 14:52:05 user nova-compute[73079]:     </disk>
Aug 17 14:52:05 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:52:05 user nova-compute[73079]:       <mac address="fa:16:3e:60:41:f9"/>
Aug 17 14:52:05 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:52:05 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:52:05 user nova-compute[73079]:       <target dev="tapd4449800-d6"/>
Aug 17 14:52:05 user nova-compute[73079]:     </interface>
Aug 17 14:52:05 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:52:05 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/67fcd60a-d9b7-45e3-b8df-56df69011831/console.log" append="off"/>
Aug 17 14:52:05 user nova-compute[73079]:     </serial>
Aug 17 14:52:05 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:52:05 user nova-compute[73079]:     <video>
Aug 17 14:52:05 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:52:05 user nova-compute[73079]:     </video>
Aug 17 14:52:05 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:52:05 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:52:05 user nova-compute[73079]:     </rng>
Aug 17 14:52:05 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:52:05 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:52:05 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:52:05 user nova-compute[73079]:     </memballoon>
Aug 17 14:52:05 user nova-compute[73079]:   </devices>
Aug 17 14:52:05 user nova-compute[73079]: </domain>
Aug 17 14:52:05 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1543664065',display_name='tempest-TestVolumeBootPattern-server-1543664065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1543664065',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-8i3s5sw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:51:41Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=67fcd60a-d9b7-45e3-b8df-56df69011831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG os_vif [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4449800-d6, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4449800-d6, col_values=(('external_ids', {'iface-id': 'd4449800-d6dc-4e62-a42f-75321633b2bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:41:f9', 'vm-uuid': '67fcd60a-d9b7-45e3-b8df-56df69011831'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:05 user nova-compute[73079]: INFO os_vif [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6')
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:52:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No VIF found with MAC fa:16:3e:60:41:f9, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-b8b34a1f-a45d-4ffc-8e4c-3243c0f4897e req-4335a8bb-4c37-4787-bc69-1904e3b4d980 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b8b34a1f-a45d-4ffc-8e4c-3243c0f4897e req-4335a8bb-4c37-4787-bc69-1904e3b4d980 service nova] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b8b34a1f-a45d-4ffc-8e4c-3243c0f4897e req-4335a8bb-4c37-4787-bc69-1904e3b4d980 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b8b34a1f-a45d-4ffc-8e4c-3243c0f4897e req-4335a8bb-4c37-4787-bc69-1904e3b4d980 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-b8b34a1f-a45d-4ffc-8e4c-3243c0f4897e req-4335a8bb-4c37-4787-bc69-1904e3b4d980 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] No waiting events found dispatching network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:52:07 user nova-compute[73079]: WARNING nova.compute.manager [req-b8b34a1f-a45d-4ffc-8e4c-3243c0f4897e req-4335a8bb-4c37-4787-bc69-1904e3b4d980 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received unexpected event network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb for instance with vm_state building and task_state spawning.
Aug 17 14:52:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:52:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283928.9818778, 67fcd60a-d9b7-45e3-b8df-56df69011831 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] VM Resumed (Lifecycle Event)
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Instance spawned successfully.
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-fa25595d-bba0-4085-8154-e6efa1b3fdb0 req-1ea253aa-6f12-4ace-86ca-bf6174b8f857 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fa25595d-bba0-4085-8154-e6efa1b3fdb0 req-1ea253aa-6f12-4ace-86ca-bf6174b8f857 service nova] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fa25595d-bba0-4085-8154-e6efa1b3fdb0 req-1ea253aa-6f12-4ace-86ca-bf6174b8f857 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fa25595d-bba0-4085-8154-e6efa1b3fdb0 req-1ea253aa-6f12-4ace-86ca-bf6174b8f857 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-fa25595d-bba0-4085-8154-e6efa1b3fdb0 req-1ea253aa-6f12-4ace-86ca-bf6174b8f857 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] No waiting events found dispatching network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:52:09 user nova-compute[73079]: WARNING nova.compute.manager [req-fa25595d-bba0-4085-8154-e6efa1b3fdb0 req-1ea253aa-6f12-4ace-86ca-bf6174b8f857 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received unexpected event network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb for instance with vm_state building and task_state spawning.
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692283928.9825213, 67fcd60a-d9b7-45e3-b8df-56df69011831 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] VM Started (Lifecycle Event)
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Took 5.15 seconds to spawn the instance on the hypervisor.
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:09 user nova-compute[73079]: INFO nova.compute.manager [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Took 28.85 seconds to build instance.
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-82cdeb09-4d25-4f91-934d-fff00a5d4a47 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.979s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:11 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:52:11 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7781MB free_disk=25.58374786376953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1bbf6615-32dd-41eb-a14c-685476f49c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 30babe22-af5d-486e-b29b-d82aa03b070d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance d1f17d9d-7ffb-4b15-abdb-39c9b979118c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 4c729310-f0a9-4faf-ab22-02c440738a43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 67fcd60a-d9b7-45e3-b8df-56df69011831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:52:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:52:12 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:52:13 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updating instance_info_cache with network_info: [{"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:52:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-1bbf6615-32dd-41eb-a14c-685476f49c5b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:52:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:52:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:52:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:52:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:52:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:52:37 user nova-compute[73079]: INFO nova.compute.manager [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] instance snapshotting
Aug 17 14:52:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Beginning live snapshot process
Aug 17 14:52:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyykdar_u/9326ad1143f04b3eb06f1f7aaaf028f0.delta 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyykdar_u/9326ad1143f04b3eb06f1f7aaaf028f0.delta 1073741824" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 14:52:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:52:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 14:52:39 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 14:52:39 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:52:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyykdar_u/9326ad1143f04b3eb06f1f7aaaf028f0.delta /opt/stack/data/nova/instances/snapshots/tmpyykdar_u/9326ad1143f04b3eb06f1f7aaaf028f0 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyykdar_u/9326ad1143f04b3eb06f1f7aaaf028f0.delta /opt/stack/data/nova/instances/snapshots/tmpyykdar_u/9326ad1143f04b3eb06f1f7aaaf028f0" returned: 0 in 0.473s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Snapshot extracted, beginning image upload
Aug 17 14:52:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Snapshot image upload complete
Aug 17 14:52:42 user nova-compute[73079]: INFO nova.compute.manager [None req-df93d87c-17e0-479c-80bc-316ff6a2f963 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Took 5.41 seconds to snapshot the instance on the hypervisor.
Aug 17 14:52:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-changed-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Refreshing instance network info cache due to event network-changed-72a82218-b019-41c8-a988-4c37a5e8d134. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] Acquiring lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] Acquired lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Refreshing network info cache for port 72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updated VIF entry in instance network info cache for port 72a82218-b019-41c8-a988-4c37a5e8d134. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updating instance_info_cache with network_info: [{"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:52:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-69bda15d-d529-4fd2-8ae0-5e365741e318 req-b1668758-4702-4eac-8fad-3911cfd75386 service nova] Releasing lock "refresh_cache-30babe22-af5d-486e-b29b-d82aa03b070d" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:52:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing instance network info cache due to event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:52:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:52:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:52:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:52:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updated VIF entry in instance network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:52:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:52:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7c0b956b-2cda-4c55-bb87-09dc245aa51c req-9fdda110-d61e-45b1-93d1-2419074493aa service nova] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:52:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-changed-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Refreshing instance network info cache due to event network-changed-0de94324-c5b6-4ca4-94da-663e06760b81. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] Acquiring lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] Acquired lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Refreshing network info cache for port 0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:51 user nova-compute[73079]: INFO nova.compute.manager [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Terminating instance
Aug 17 14:52:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:52 user nova-compute[73079]: INFO nova.compute.manager [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attaching volume e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e to /dev/vdb
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_brick.utils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c8d8b-e5e4-4890-a7e6-d86ec787b535]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c107e69-1554-4f47-bcf6-6120e6b9b924]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e82b31-a448-48a0-b9e7-0b5d60e92a36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Instance destroyed successfully.
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'resources' on Instance uuid 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaa5a9d-37d4-42e4-b2d1-ee47556fd083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2016125783',display_name='tempest-AttachVolumeNegativeTest-server-2016125783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2016125783',id=22,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET7RhR25QcpLVKFRzaQPJ3r+XmthehoyD7BrEBM3sEe1OTxGIsmdgRdTvJNeQs3iUvJRz2b+7oqZr4DKfWiD0s17QsPhsd2h67ciY0heuFrPzMUetHUBWpxOc5xzjmUbA==',key_name='tempest-keypair-2003400962',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-dq60osx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=58f0e1c8-d58a-4478-aeb2-d1d42df3e984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_vif [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0de94324-c5, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:52:52 user nova-compute[73079]: INFO os_vif [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2d:93,bridge_name='br-int',has_traffic_filtering=True,id=0de94324-c5b6-4ca4-94da-663e06760b81,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0de94324-c5')
Aug 17 14:52:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Deleting instance files /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984_del
Aug 17 14:52:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Deletion of /opt/stack/data/nova/instances/58f0e1c8-d58a-4478-aeb2-d1d42df3e984_del complete
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:52:52 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c77ed-481f-4c53-bd2a-b75312331593]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG os_brick.utils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updating existing volume attachment record: cc9d4818-05a6-4dbc-b14d-f0b413187d0d {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:52:52 user nova-compute[73079]: INFO nova.compute.manager [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Updated VIF entry in instance network info cache for port 0de94324-c5b6-4ca4-94da-663e06760b81. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Updating instance_info_cache with network_info: [{"id": "0de94324-c5b6-4ca4-94da-663e06760b81", "address": "fa:16:3e:3a:2d:93", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0de94324-c5", "ovs_interfaceid": "0de94324-c5b6-4ca4-94da-663e06760b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:52:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-194abf6f-f738-49f8-bd31-1fe5910d16bb req-f6f1699e-159c-488f-867d-b675b1b9ddfe service nova] Releasing lock "refresh_cache-58f0e1c8-d58a-4478-aeb2-d1d42df3e984" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-c6ed0c04-eeb1-4455-8d9c-3f3c7b68599f req-cd23bdc6-0285-4c24-8fb2-e0f55fcb7a6a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-vif-unplugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c6ed0c04-eeb1-4455-8d9c-3f3c7b68599f req-cd23bdc6-0285-4c24-8fb2-e0f55fcb7a6a service nova] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c6ed0c04-eeb1-4455-8d9c-3f3c7b68599f req-cd23bdc6-0285-4c24-8fb2-e0f55fcb7a6a service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c6ed0c04-eeb1-4455-8d9c-3f3c7b68599f req-cd23bdc6-0285-4c24-8fb2-e0f55fcb7a6a service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-c6ed0c04-eeb1-4455-8d9c-3f3c7b68599f req-cd23bdc6-0285-4c24-8fb2-e0f55fcb7a6a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] No waiting events found dispatching network-vif-unplugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:52:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-c6ed0c04-eeb1-4455-8d9c-3f3c7b68599f req-cd23bdc6-0285-4c24-8fb2-e0f55fcb7a6a service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-vif-unplugged-0de94324-c5b6-4ca4-94da-663e06760b81 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:52:54 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:52:54 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Took 1.68 seconds to deallocate network for instance.
Aug 17 14:52:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:54 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:52:54 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:52:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:54 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Deleted allocations for instance 58f0e1c8-d58a-4478-aeb2-d1d42df3e984
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8ecaa8fb-7392-4cd3-88ea-e230ba55d32e tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:55 user nova-compute[73079]: INFO nova.compute.manager [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Shelving
Aug 17 14:52:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] Acquiring lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] Lock "58f0e1c8-d58a-4478-aeb2-d1d42df3e984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] No waiting events found dispatching network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:52:55 user nova-compute[73079]: WARNING nova.compute.manager [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received unexpected event network-vif-plugged-0de94324-c5b6-4ca4-94da-663e06760b81 for instance with vm_state deleted and task_state None.
Aug 17 14:52:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-12d8bf4e-051b-43f5-b912-9458a6113e23 req-8a01215d-87b4-4215-86f2-f21829cfd6e7 service nova] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Received event network-vif-deleted-0de94324-c5b6-4ca4-94da-663e06760b81 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-e787efe1-bcc1-4a9f-a804-70ea23e01432 req-d3b3fae5-0973-4484-be4b-13e3ac2179d6 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-unplugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e787efe1-bcc1-4a9f-a804-70ea23e01432 req-d3b3fae5-0973-4484-be4b-13e3ac2179d6 service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e787efe1-bcc1-4a9f-a804-70ea23e01432 req-d3b3fae5-0973-4484-be4b-13e3ac2179d6 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e787efe1-bcc1-4a9f-a804-70ea23e01432 req-d3b3fae5-0973-4484-be4b-13e3ac2179d6 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-e787efe1-bcc1-4a9f-a804-70ea23e01432 req-d3b3fae5-0973-4484-be4b-13e3ac2179d6 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-unplugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:52:55 user nova-compute[73079]: WARNING nova.compute.manager [req-e787efe1-bcc1-4a9f-a804-70ea23e01432 req-d3b3fae5-0973-4484-be4b-13e3ac2179d6 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-unplugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state active and task_state shelving.
Aug 17 14:52:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance destroyed successfully.
Aug 17 14:52:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Beginning cold snapshot process
Aug 17 14:52:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:56 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:52:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk /opt/stack/data/nova/instances/snapshots/tmpsrli7hn3/dae3efae107d4a6cba265108192a387d {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:52:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:52:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk /opt/stack/data/nova/instances/snapshots/tmpsrli7hn3/dae3efae107d4a6cba265108192a387d" returned: 0 in 1.029s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:52:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Snapshot extracted, beginning image upload
Aug 17 14:52:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-25e4c82e-cbf0-4427-942b-10b1b8bb94a7 req-287a8ef7-6360-4f3f-b705-b351f01ca822 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:52:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-25e4c82e-cbf0-4427-942b-10b1b8bb94a7 req-287a8ef7-6360-4f3f-b705-b351f01ca822 service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:52:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-25e4c82e-cbf0-4427-942b-10b1b8bb94a7 req-287a8ef7-6360-4f3f-b705-b351f01ca822 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:52:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-25e4c82e-cbf0-4427-942b-10b1b8bb94a7 req-287a8ef7-6360-4f3f-b705-b351f01ca822 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:52:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-25e4c82e-cbf0-4427-942b-10b1b8bb94a7 req-287a8ef7-6360-4f3f-b705-b351f01ca822 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:52:58 user nova-compute[73079]: WARNING nova.compute.manager [req-25e4c82e-cbf0-4427-942b-10b1b8bb94a7 req-287a8ef7-6360-4f3f-b705-b351f01ca822 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 14:52:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Snapshot image upload complete
Aug 17 14:53:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:00 user nova-compute[73079]: INFO nova.compute.manager [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Shelve offloading
Aug 17 14:53:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance destroyed successfully.
Aug 17 14:53:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:00 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:53:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance destroyed successfully.
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'resources' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133672793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133672793',id=21,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARxs6R8GIWvCZaN27p04AKhZgUrXAz57K69xG6NJf9Q+kTa+6hilQRHmRPIa8CWGAITlhUfltflCBV22ywZcLP1Wl7eawRO05FCEuBq/7UWL1tBdCJeGScBFR0Fa7SS6w==',key_name='tempest-keypair-756591381',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-a1wbitbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member',shelved_at='2023-08-17T14:53:00.539959',shelved_host='user',shelved_image_id='8c61bf1c-5059-4719-ae57-c4ae2b55607d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=d1f17d9d-7ffb-4b15-abdb-39c9b979118c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG os_vif [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape242a398-9d, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:03 user nova-compute[73079]: INFO os_vif [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d')
Aug 17 14:53:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Deleting instance files /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c_del
Aug 17 14:53:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Deletion of /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c_del complete
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing instance network info cache due to event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.network.neutron [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:03 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Deleted allocations for instance d1f17d9d-7ffb-4b15-abdb-39c9b979118c
Aug 17 14:53:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'numa_topology' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4886c018-c023-447c-a6c8-28f1db8d714d tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.103s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing instance network info cache due to event network-changed-4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] Acquiring lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] Acquired lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Refreshing network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:04 user nova-compute[73079]: INFO nova.compute.manager [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Terminating instance
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updated VIF entry in instance network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape242a398-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-20fd0085-71dc-4852-8d46-a1f8df971042 req-d6ae4436-fecb-4117-8710-0ff3f2426a22 service nova] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updated VIF entry in instance network info cache for port 4569de50-d6e2-4623-8b72-c2f9a25a4279. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.neutron [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [{"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fed72877-95c5-4738-85a0-7b5f5a2b1e91 req-abc1beb6-d598-49d6-b80c-23174d852c47 service nova] Releasing lock "refresh_cache-4c729310-f0a9-4faf-ab22-02c440738a43" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Instance destroyed successfully.
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lazy-loading 'resources' on Instance uuid 4c729310-f0a9-4faf-ab22-02c440738a43 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2034968715',display_name='tempest-TestShelveInstance-server-2034968715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2034968715',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbGklE/wIZHfre7/KNRyaOYhfx9Ub85b5BHkSuHI78cUei5tmdmA06ZzGd6VV3OrmVHzGwMAwituwDPQcNVFrxlKVO53+m+KaPpwVtFoir5ymc3bkR/Cqvhak6QwxrdwA==',key_name='tempest-TestShelveInstance-844004364',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54af3e289d9e4aa1bc8f1c93716310dd',ramdisk_id='',reservation_id='r-kz120ti7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-341194626',owner_user_name='tempest-TestShelveInstance-341194626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:51:35Z,user_data=None,user_id='d28228aad23b4fceaa2c672075af526c',uuid=4c729310-f0a9-4faf-ab22-02c440738a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converting VIF {"id": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "address": "fa:16:3e:e5:ac:71", "network": {"id": "795a5faf-5d3b-4be7-914c-fee0a8002d1f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1058450609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54af3e289d9e4aa1bc8f1c93716310dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4569de50-d6", "ovs_interfaceid": "4569de50-d6e2-4623-8b72-c2f9a25a4279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG os_vif [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4569de50-d6, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:53:04 user nova-compute[73079]: INFO os_vif [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=4569de50-d6e2-4623-8b72-c2f9a25a4279,network=Network(795a5faf-5d3b-4be7-914c-fee0a8002d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4569de50-d6')
Aug 17 14:53:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReNqmEwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:53:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf35510e-4bdf-4d48-8113-6e3317afb1f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b7ef79-6902-4e78-a025-51a3d5d636e9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8093400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b28fe72-a497-4b61-8ed0-d4fc6afbe203]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[97721d84-abb1-454d-bfef-cc4c84c65366]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf55c7f-915e-48a0-adba-5f0d7683fba1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[139dfcdf-0ffe-4010-ab56-a7a58c6dd680]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cd9d6505', '/dev/disk/by-id/scsi-1SCST_BIOcd9d6505-35b559079d8e81dd', '/dev/disk/by-id/scsi-23335623535393037') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff0a503-b0b9-4d20-a3d7-2d4c26b4125e]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff5037-7c0c-449b-9e18-95f71472a5ea]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508354c-2e14-4e36-a999-df61290b71d5]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260]
Aug 17 14:53:05 user nova-compute[73079]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDjIfKpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:05 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d28c05-99d0-4909-883b-11dceff37a41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[99de00ac-eaa5-430d-b4e8-06592d995e42]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] <== disconnect_volume: return (366ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:53:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Deleting instance files /opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43_del
Aug 17 14:53:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Deletion of /opt/stack/data/nova/instances/4c729310-f0a9-4faf-ab22-02c440738a43_del complete
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.022s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:05 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:05 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f22988-7fff-4156-bf3c-8263ee062636]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:53:05 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d52d8e-b029-42c5-bf34-a84b475d6fa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e] added
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: INFO nova.compute.manager [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec5311a-609b-4ec1-8143-729566d639b9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[94429f84-277f-4741-8a34-3fc75e74b34b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDjIfKpP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDjIfKpP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e256b3-e963-45a7-ac28-12775be4e059]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oDjIfKpP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7436b431-19c2-4e91-9ec2-10cda6e4d181]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6e841-092a-4e1e-8e95-661f61cdce99]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a4f694-7e91-40e4-a311-9aa110cacef0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260]
Aug 17 14:53:05 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6465d-f3ff-4c23-816e-a2c7cca5ffc9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bad1e5-1a07-489a-959e-0e6e377931e9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7a804d-7bf5-4ae5-823e-a51f5825dea6]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:53:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDjIfKpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:06 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Took 0.70 seconds to deallocate network for instance.
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-f1041eab-9b9f-40d7-868b-27635df1489d req-d9c5c35c-7011-4ddc-9f77-dfc9135c6a27 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Received event network-vif-deleted-4569de50-d6e2-4623-8b72-c2f9a25a4279 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:06 user nova-compute[73079]: INFO nova.compute.manager [req-f1041eab-9b9f-40d7-868b-27635df1489d req-d9c5c35c-7011-4ddc-9f77-dfc9135c6a27 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Neutron deleted interface 4569de50-d6e2-4623-8b72-c2f9a25a4279; detaching it from the instance and deleting it from the info cache
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.network.neutron [req-f1041eab-9b9f-40d7-868b-27635df1489d req-d9c5c35c-7011-4ddc-9f77-dfc9135c6a27 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-f1041eab-9b9f-40d7-868b-27635df1489d req-d9c5c35c-7011-4ddc-9f77-dfc9135c6a27 service nova] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Detach interface failed, port_id=4569de50-d6e2-4623-8b72-c2f9a25a4279, reason: Instance 4c729310-f0a9-4faf-ab22-02c440738a43 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23334326636636565', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334326636636565', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:53:06 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:06 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:53:06 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:53:06 user nova-compute[73079]:   <serial>e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e</serial>
Aug 17 14:53:06 user nova-compute[73079]: </disk>
Aug 17 14:53:06 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:53:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:06 user nova-compute[73079]: INFO nova.compute.manager [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 14:53:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Deleting volume: b0d28c05-99d0-4909-883b-11dceff37a41 {{(pid=73079) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No VIF found with MAC fa:16:3e:b8:fa:77, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0f906ce6-b643-4282-9af8-9723bcf02de4 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.855s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:07 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Deleted allocations for instance 4c729310-f0a9-4faf-ab22-02c440738a43
Aug 17 14:53:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-ac6e8d8f-ccaa-4aa6-9201-420e3b40df74 tempest-TestShelveInstance-341194626 tempest-TestShelveInstance-341194626-project-member] Lock "4c729310-f0a9-4faf-ab22-02c440738a43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.314s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283972.634025, 58f0e1c8-d58a-4478-aeb2-d1d42df3e984 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:07 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] VM Stopped (Lifecycle Event)
Aug 17 14:53:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7bd53ba2-dbc4-4174-81c6-f220ab75f6c1 None None] [instance: 58f0e1c8-d58a-4478-aeb2-d1d42df3e984] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:53:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283976.4589863, d1f17d9d-7ffb-4b15-abdb-39c9b979118c => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:11 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] VM Stopped (Lifecycle Event)
Aug 17 14:53:11 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e4d66c3e-955d-4b8f-8208-80158e4e3750 None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:53:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8148MB free_disk=25.535171508789062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1bbf6615-32dd-41eb-a14c-685476f49c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 30babe22-af5d-486e-b29b-d82aa03b070d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 67fcd60a-d9b7-45e3-b8df-56df69011831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:53:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:53:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:15 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:53:15 user nova-compute[73079]: INFO nova.compute.claims [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Claim successful on node user
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:53:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.policy [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c39dfbcb35f4931bd954af908be42c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1639547e2c64318a67d2551533df958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:53:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Creating image(s)
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "/opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "/opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "/opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk 1073741824" returned: 0 in 0.059s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Successfully created port: 6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.213s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:17 user nova-compute[73079]: INFO nova.compute.manager [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attaching volume af3961f2-3e21-4524-8f29-f8d6ab8c2d90 to /dev/vdc
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Cannot resize image /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lazy-loading 'migration_context' on Instance uuid f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG os_brick.utils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Ensure instance console log exists: /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b21d11-04a9-419d-894b-66ad31a57a52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ca4ff-af87-4d68-91a3-d3fe5f89803e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6d340-411c-4441-a9a8-6f1da79312c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[26004288-dcfa-4af8-b43c-1d0a02c9b325]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:17 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f7b7f-7e48-43b7-9821-4db2a29a50ae]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG os_brick.utils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updating existing volume attachment record: 1dc60416-19b4-4d70-b151-bf3ad0c42341 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Successfully updated port: 6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquired lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-changed-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Refreshing instance network info cache due to event network-changed-6d05a5a0-ca5c-4036-ae62-30d073baa3e3. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] Acquiring lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updating instance_info_cache with network_info: [{"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Releasing lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Instance network_info: |[{"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] Acquired lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Refreshing network info cache for port 6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Start _get_guest_xml network_info=[{"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:53:18 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:53:18 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1288181',id=24,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCPJeuIAxVfiaXS8Y54+2wQZ5GzMsn5f4drLWcwnWvYC1AZTGziPWWdasjpCfDNnIbeBdF6bQPLNY5+UL8RebQtEtphFt7QbutAhxfHy7OHujuvwIRKH/KG+pQdCkejhw==',key_name='tempest-keypair-1922212375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1639547e2c64318a67d2551533df958',ramdisk_id='',reservation_id='r-dramxteq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517511284',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c39dfbcb35f4931bd954af908be42c4',uuid=f25d4a41-0990-48b1-a2a9-fd3849526044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Converting VIF {"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lazy-loading 'pci_devices' on Instance uuid f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:53:18 user nova-compute[73079]:   <uuid>f25d4a41-0990-48b1-a2a9-fd3849526044</uuid>
Aug 17 14:53:18 user nova-compute[73079]:   <name>instance-00000018</name>
Aug 17 14:53:18 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:53:18 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:53:18 user nova-compute[73079]:   <metadata>
Aug 17 14:53:18 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:53:18 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:53:18 user nova-compute[73079]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271</nova:name>
Aug 17 14:53:18 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:53:18</nova:creationTime>
Aug 17 14:53:18 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:53:18 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:53:18 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:53:18 user nova-compute[73079]:       <nova:owner>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:user uuid="8c39dfbcb35f4931bd954af908be42c4">tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member</nova:user>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:project uuid="b1639547e2c64318a67d2551533df958">tempest-TestServerVolumeAttachScenarioOldVersion-1517511284</nova:project>
Aug 17 14:53:18 user nova-compute[73079]:       </nova:owner>
Aug 17 14:53:18 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:53:18 user nova-compute[73079]:       <nova:ports>
Aug 17 14:53:18 user nova-compute[73079]:         <nova:port uuid="6d05a5a0-ca5c-4036-ae62-30d073baa3e3">
Aug 17 14:53:18 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 14:53:18 user nova-compute[73079]:         </nova:port>
Aug 17 14:53:18 user nova-compute[73079]:       </nova:ports>
Aug 17 14:53:18 user nova-compute[73079]:     </nova:instance>
Aug 17 14:53:18 user nova-compute[73079]:   </metadata>
Aug 17 14:53:18 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:53:18 user nova-compute[73079]:     <system>
Aug 17 14:53:18 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:53:18 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:53:18 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:53:18 user nova-compute[73079]:       <entry name="serial">f25d4a41-0990-48b1-a2a9-fd3849526044</entry>
Aug 17 14:53:18 user nova-compute[73079]:       <entry name="uuid">f25d4a41-0990-48b1-a2a9-fd3849526044</entry>
Aug 17 14:53:18 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:53:18 user nova-compute[73079]:     </system>
Aug 17 14:53:18 user nova-compute[73079]:   </sysinfo>
Aug 17 14:53:18 user nova-compute[73079]:   <os>
Aug 17 14:53:18 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:53:18 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:53:18 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:53:18 user nova-compute[73079]:   </os>
Aug 17 14:53:18 user nova-compute[73079]:   <features>
Aug 17 14:53:18 user nova-compute[73079]:     <acpi/>
Aug 17 14:53:18 user nova-compute[73079]:     <apic/>
Aug 17 14:53:18 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:53:18 user nova-compute[73079]:   </features>
Aug 17 14:53:18 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:53:18 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:53:18 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:53:18 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:53:18 user nova-compute[73079]:   </clock>
Aug 17 14:53:18 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:53:18 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:53:18 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:53:18 user nova-compute[73079]:   </cpu>
Aug 17 14:53:18 user nova-compute[73079]:   <devices>
Aug 17 14:53:18 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:53:18 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:53:18 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk"/>
Aug 17 14:53:18 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:53:18 user nova-compute[73079]:     </disk>
Aug 17 14:53:18 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:53:18 user nova-compute[73079]:       <mac address="fa:16:3e:7a:53:23"/>
Aug 17 14:53:18 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:53:18 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:53:18 user nova-compute[73079]:       <target dev="tap6d05a5a0-ca"/>
Aug 17 14:53:18 user nova-compute[73079]:     </interface>
Aug 17 14:53:18 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:53:18 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/console.log" append="off"/>
Aug 17 14:53:18 user nova-compute[73079]:     </serial>
Aug 17 14:53:18 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:53:18 user nova-compute[73079]:     <video>
Aug 17 14:53:18 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:53:18 user nova-compute[73079]:     </video>
Aug 17 14:53:18 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:53:18 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:53:18 user nova-compute[73079]:     </rng>
Aug 17 14:53:18 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:53:18 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:53:18 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:53:18 user nova-compute[73079]:     </memballoon>
Aug 17 14:53:18 user nova-compute[73079]:   </devices>
Aug 17 14:53:18 user nova-compute[73079]: </domain>
Aug 17 14:53:18 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1288181',id=24,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCPJeuIAxVfiaXS8Y54+2wQZ5GzMsn5f4drLWcwnWvYC1AZTGziPWWdasjpCfDNnIbeBdF6bQPLNY5+UL8RebQtEtphFt7QbutAhxfHy7OHujuvwIRKH/KG+pQdCkejhw==',key_name='tempest-keypair-1922212375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1639547e2c64318a67d2551533df958',ramdisk_id='',reservation_id='r-dramxteq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517511284',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c39dfbcb35f4931bd954af908be42c4',uuid=f25d4a41-0990-48b1-a2a9-fd3849526044,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Converting VIF {"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG os_vif [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d05a5a0-ca, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d05a5a0-ca, col_values=(('external_ids', {'iface-id': '6d05a5a0-ca5c-4036-ae62-30d073baa3e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:53:23', 'vm-uuid': 'f25d4a41-0990-48b1-a2a9-fd3849526044'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:18 user nova-compute[73079]: INFO os_vif [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca')
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] No VIF found with MAC fa:16:3e:7a:53:23, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updated VIF entry in instance network info cache for port 6d05a5a0-ca5c-4036-ae62-30d073baa3e3. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updating instance_info_cache with network_info: [{"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fe180900-48c4-4fc4-98d1-dfb5f1d587d6 req-f822fcb5-a4c6-452b-9f8a-9686b0788e8c service nova] Releasing lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:19 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692283984.9268444, 4c729310-f0a9-4faf-ab22-02c440738a43 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:19 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] VM Stopped (Lifecycle Event)
Aug 17 14:53:19 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4057332b-1163-4bd8-819e-9b16b74b48ca None None] [instance: 4c729310-f0a9-4faf-ab22-02c440738a43] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-01010264-83ec-4f1b-a711-c35a2a0f205d req-46bdc406-1e0c-4c86-9af7-b6ddb4338be5 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-01010264-83ec-4f1b-a711-c35a2a0f205d req-46bdc406-1e0c-4c86-9af7-b6ddb4338be5 service nova] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-01010264-83ec-4f1b-a711-c35a2a0f205d req-46bdc406-1e0c-4c86-9af7-b6ddb4338be5 service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-01010264-83ec-4f1b-a711-c35a2a0f205d req-46bdc406-1e0c-4c86-9af7-b6ddb4338be5 service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-01010264-83ec-4f1b-a711-c35a2a0f205d req-46bdc406-1e0c-4c86-9af7-b6ddb4338be5 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] No waiting events found dispatching network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:53:20 user nova-compute[73079]: WARNING nova.compute.manager [req-01010264-83ec-4f1b-a711-c35a2a0f205d req-46bdc406-1e0c-4c86-9af7-b6ddb4338be5 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received unexpected event network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 for instance with vm_state building and task_state spawning.
Aug 17 14:53:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284002.22346, f25d4a41-0990-48b1-a2a9-fd3849526044 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] VM Resumed (Lifecycle Event)
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Instance spawned successfully.
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284002.2246501, f25d4a41-0990-48b1-a2a9-fd3849526044 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] VM Started (Lifecycle Event)
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-77e907c8-e43d-49e1-8174-936c4dc623c6 req-9605153c-194f-4a67-b426-2e53ca5b3a85 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-77e907c8-e43d-49e1-8174-936c4dc623c6 req-9605153c-194f-4a67-b426-2e53ca5b3a85 service nova] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-77e907c8-e43d-49e1-8174-936c4dc623c6 req-9605153c-194f-4a67-b426-2e53ca5b3a85 service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-77e907c8-e43d-49e1-8174-936c4dc623c6 req-9605153c-194f-4a67-b426-2e53ca5b3a85 service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-77e907c8-e43d-49e1-8174-936c4dc623c6 req-9605153c-194f-4a67-b426-2e53ca5b3a85 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] No waiting events found dispatching network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:53:22 user nova-compute[73079]: WARNING nova.compute.manager [req-77e907c8-e43d-49e1-8174-936c4dc623c6 req-9605153c-194f-4a67-b426-2e53ca5b3a85 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received unexpected event network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 for instance with vm_state building and task_state spawning.
Aug 17 14:53:22 user nova-compute[73079]: INFO nova.compute.manager [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Took 6.53 seconds to build instance.
Aug 17 14:53:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6eacc56f-d06a-401d-bab4-c7c7cf529e6c tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.637s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:31 user nova-compute[73079]: INFO nova.compute.manager [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Terminating instance
Aug 17 14:53:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-d532b3c0-0fb1-4822-af1c-27883408839f req-dac003c0-5d47-496d-b031-c94d80556ab1 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-vif-unplugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d532b3c0-0fb1-4822-af1c-27883408839f req-dac003c0-5d47-496d-b031-c94d80556ab1 service nova] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d532b3c0-0fb1-4822-af1c-27883408839f req-dac003c0-5d47-496d-b031-c94d80556ab1 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d532b3c0-0fb1-4822-af1c-27883408839f req-dac003c0-5d47-496d-b031-c94d80556ab1 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-d532b3c0-0fb1-4822-af1c-27883408839f req-dac003c0-5d47-496d-b031-c94d80556ab1 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] No waiting events found dispatching network-vif-unplugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-d532b3c0-0fb1-4822-af1c-27883408839f req-dac003c0-5d47-496d-b031-c94d80556ab1 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-vif-unplugged-d4449800-d6dc-4e62-a42f-75321633b2bb for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:53:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Instance destroyed successfully.
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'resources' on Instance uuid 67fcd60a-d9b7-45e3-b8df-56df69011831 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1543664065',display_name='tempest-TestVolumeBootPattern-server-1543664065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1543664065',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:52:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-8i3s5sw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:52:09Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=67fcd60a-d9b7-45e3-b8df-56df69011831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "d4449800-d6dc-4e62-a42f-75321633b2bb", "address": "fa:16:3e:60:41:f9", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4449800-d6", "ovs_interfaceid": "d4449800-d6dc-4e62-a42f-75321633b2bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_vif [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4449800-d6, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:53:32 user nova-compute[73079]: INFO os_vif [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4449800-d6dc-4e62-a42f-75321633b2bb,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4449800-d6')
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPiAIuGn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:32 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01a8f8-60c5-4a5d-92bd-4636cdd9309a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[054af438-86ed-4c2c-81a6-c833c2dd8f4c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:32 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:32 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:32 user nova-compute[73079]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e (non-flash)
Aug 17 14:53:32 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e81d11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[238d7319-8497-4503-8826-0bf3e950adab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc432e17-5cd5-4f9b-badf-b172392c4070]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e51dda-172f-4e1e-975b-c55fb6db6d5d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f854d0b4-94a0-46db-9934-28734b865e7f]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc34aee34-176ca9bdb822274e', '/dev/disk/by-id/scsi-23137366361396264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c34aee34') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[18140391-437e-4efe-9659-efcf52d24fb2]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f1ff1-3da9-49ed-aca3-143967195916]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46408e8-497f-45de-ad89-801f5b16a166]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260]
Aug 17 14:53:32 user nova-compute[73079]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500cafa-240a-46d6-9f7a-effc10e68b8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3c926-61cf-4f7b-9182-d4182be15338]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== disconnect_volume: return (339ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:53:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Deleting instance files /opt/stack/data/nova/instances/67fcd60a-d9b7-45e3-b8df-56df69011831_del
Aug 17 14:53:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Deletion of /opt/stack/data/nova/instances/67fcd60a-d9b7-45e3-b8df-56df69011831_del complete
Aug 17 14:53:32 user nova-compute[73079]: INFO nova.compute.manager [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVKCZzyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:32 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:32 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:32 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ffd99c-1fb8-4c2d-91f7-c99fe024d308]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:53:32 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d460fc7-87d5-41aa-87fa-8fe414ddea15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90] added
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d717ee-3a07-4b8e-a37e-81d65ae33d25]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6d77d7-b86e-4f76-a873-eb8e1b235e30]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVKCZzyw {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVKCZzyw" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08662d-625b-4e69-a543-9639a821f1e3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IVKCZzyw'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d24a53-2428-4dc2-8ea0-4af1c5ee3404]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04cb65f-5687-453d-90f6-7ddfe03af5da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:32 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:32 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3997e685-ccf9-4cf7-8620-da5809f5e397]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260]
Aug 17 14:53:32 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff948bbd-c1a5-4335-a2c6-b378bd0f2eb1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:33 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Took 0.55 seconds to deallocate network for instance.
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6223e7-f71a-48f1-8805-95543ef3e5f4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:33 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:33 user nova-compute[73079]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)
Aug 17 14:53:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:33 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:33 user nova-compute[73079]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)
Aug 17 14:53:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9ae9f0-69b6-4727-8adc-89df883bb60f]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVKCZzyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] Acquiring lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] No waiting events found dispatching network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:53:33 user nova-compute[73079]: WARNING nova.compute.manager [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received unexpected event network-vif-plugged-d4449800-d6dc-4e62-a42f-75321633b2bb for instance with vm_state active and task_state deleting.
Aug 17 14:53:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-60a61243-8957-4ebc-acf1-8f4bbc750681 req-ef672ec4-6df3-43bc-a1f4-e1831e1332a3 service nova] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Received event network-vif-deleted-d4449800-d6dc-4e62-a42f-75321633b2bb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:33 user nova-compute[73079]: INFO nova.compute.manager [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Took 0.82 seconds to detach 1 volumes for instance.
Aug 17 14:53:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Deleting volume: 7500cafa-240a-46d6-9f7a-effc10e68b8e {{(pid=73079) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23433346435343932', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433346435343932', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:53:34 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:34 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:53:34 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:53:34 user nova-compute[73079]:   <serial>af3961f2-3e21-4524-8f29-f8d6ab8c2d90</serial>
Aug 17 14:53:34 user nova-compute[73079]: </disk>
Aug 17 14:53:34 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:34 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Deleted allocations for instance 67fcd60a-d9b7-45e3-b8df-56df69011831
Aug 17 14:53:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a7dadc-5045-4ccd-ae96-6f5e0c395964 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "67fcd60a-d9b7-45e3-b8df-56df69011831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.179s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] No VIF found with MAC fa:16:3e:b8:fa:77, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:53:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b0adfcca-5825-43e5-9fed-b4eb1cb8dd1b tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.518s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.compute.manager [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Detaching volume e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "3ef3f716-ed73-4478-b367-37ac0377df63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.virt.block_device [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attempting to driver detach volume e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e from mountpoint /dev/vdb
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Attempting to detach device vdb from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:53:36 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:36 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:53:36 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:53:36 user nova-compute[73079]:   <serial>e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e</serial>
Aug 17 14:53:36 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:53:36 user nova-compute[73079]: </disk>
Aug 17 14:53:36 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully detached device vdb from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the persistent domain config.
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:53:36 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:36 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 14:53:36 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:53:36 user nova-compute[73079]:   <serial>e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e</serial>
Aug 17 14:53:36 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:53:36 user nova-compute[73079]: </disk>
Aug 17 14:53:36 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.compute.claims [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Claim successful on node user
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:53:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284016.770408, 30babe22-af5d-486e-b29b-d82aa03b070d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully detached device vdb from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the live domain config.
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDjIfKpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:36 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3305ba75-de27-411f-8caf-a6c387f9c0e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[37215f2e-1b20-45b2-a735-6498ba05a88c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:36 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:36 user nova-compute[73079]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)
Aug 17 14:53:36 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:36 user nova-compute[73079]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e (non-flash)
Aug 17 14:53:36 user nova-compute[73079]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)
Aug 17 14:53:36 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c8667e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: INFO nova.virt.block_device [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Booting with volume 003d8b35-b4f7-4883-921e-6254261f6228 at /dev/vda
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd83df8-b397-4525-b95a-2183b3347a9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[daab36dd-b35a-4363-82ce-2be3574e71c0]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e87bbf-fa8d-41a4-bdab-de0ecfefbec0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.utils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f307ee2-5505-48f8-bb1f-0c79f7cb2f1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ece3ac-4ecb-47d6-8e13-433bbab3b87d]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d99fc33-169b-4c48-9ae1-85fa0b9e8e19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0282a-534c-40fe-a12b-18ced81b999a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[17972421-3ceb-454f-a899-6595a0efa40c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba22c51-8725-4af5-8838-20a7fdfacf97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b36851-d06e-47dd-a756-cf8f33620c4d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260]
Aug 17 14:53:37 user nova-compute[73079]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:37 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf038b3a-65af-45c6-9732-e91443198491]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.utils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating existing volume attachment record: 2dba358e-be10-4a76-9302-8bf047576be5 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f59d8a-bd8f-44a2-9b0e-3f9772f5e40e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33787876-1b00-42bb-8fe4-5f5a6b49422a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== disconnect_volume: return (306ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG nova.policy [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5f41d1f2aac44178df8d963f84859d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbd1df658bf4985a76bd23a1ab2a8a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully created port: fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a499227c-02b4-4ac9-b715-c0dbea7b1447 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.898s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:38 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully created port: d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:38 user nova-compute[73079]: INFO nova.compute.manager [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Detaching volume af3961f2-3e21-4524-8f29-f8d6ab8c2d90
Aug 17 14:53:38 user nova-compute[73079]: INFO nova.virt.block_device [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Attempting to driver detach volume af3961f2-3e21-4524-8f29-f8d6ab8c2d90 from mountpoint /dev/vdc
Aug 17 14:53:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Attempting to detach device vdc from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:53:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:53:38 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:38 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:53:38 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:53:38 user nova-compute[73079]:   <serial>af3961f2-3e21-4524-8f29-f8d6ab8c2d90</serial>
Aug 17 14:53:38 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 14:53:38 user nova-compute[73079]: </disk>
Aug 17 14:53:38 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:53:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully detached device vdc from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the persistent domain config.
Aug 17 14:53:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:53:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:53:38 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:38 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:53:38 user nova-compute[73079]:   <target dev="vdc" bus="virtio"/>
Aug 17 14:53:38 user nova-compute[73079]:   <serial>af3961f2-3e21-4524-8f29-f8d6ab8c2d90</serial>
Aug 17 14:53:38 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 14:53:38 user nova-compute[73079]: </disk>
Aug 17 14:53:38 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284019.0366797, 30babe22-af5d-486e-b29b-d82aa03b070d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:53:39 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully detached device vdc from instance 30babe22-af5d-486e-b29b-d82aa03b070d from the live domain config.
Aug 17 14:53:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVKCZzyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:39 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully created port: 50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154a210-5f1e-46fe-8742-6ff1a8bd1654]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9bae80-b2c2-4b94-8826-56b3deee1a89]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:39 user nova-compute[73079]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)
Aug 17 14:53:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:39 user nova-compute[73079]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 (non-flash)
Aug 17 14:53:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c84e2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a0e066-e299-4f3d-ad21-421196ab6cbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fdd8d3-af84-463d-868a-64825eee7702]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae74334-2887-41fb-8dc9-e93b9d18ba2c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a12d764-28be-47d6-a356-b3836ff7bc7a]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4acfa77-c4cf-4301-9ad1-4bc530a2fd40]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[95853715-5c61-436f-9278-45628c9344e9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260]
Aug 17 14:53:39 user nova-compute[73079]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af3961f2-3e21-4524-8f29-f8d6ab8c2d90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cdcdbf-00b9-44b7-9c71-397e4ca5b1a8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] <== disconnect_volume: return (274ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:53:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully created port: 9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'flavor' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1f789a7f-98a0-4329-aea4-bb4b8db5f748 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully created port: 85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:41 user nova-compute[73079]: INFO nova.compute.manager [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Terminating instance
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-fe741116-543b-4c4f-bb8a-93bfa769d439. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cad7aba5-009f-4f57-805a-e4ba873b213b req-58773420-b3b2-47c9-b5ea-085e9ac80001 service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Instance destroyed successfully.
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lazy-loading 'resources' on Instance uuid 30babe22-af5d-486e-b29b-d82aa03b070d {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1388930478',display_name='tempest-AttachVolumeTestJSON-server-1388930478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1388930478',id=20,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYEU0/eATPMIAMVffb7Fg+AwxgjLE+Fgv+c5pu+SKeyuavIQR/xLFH3e3FsZhdN39DgQsfUZMtPO+cBQrZ5ZhI0hitTs+JEuxruCd3Uu9gHvOGS4a4IXSJItXj91NMpAA==',key_name='tempest-keypair-575381693',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:51:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3052ad0ca90d483284dd52edd3a79fbe',ramdisk_id='',reservation_id='r-1rcrrpjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-831896009',owner_user_name='tempest-AttachVolumeTestJSON-831896009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e233ac54eb804ff0b6fdbf986a70dfe8',uuid=30babe22-af5d-486e-b29b-d82aa03b070d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converting VIF {"id": "72a82218-b019-41c8-a988-4c37a5e8d134", "address": "fa:16:3e:b8:fa:77", "network": {"id": "f81db18d-4b60-4c59-9703-00f2a5e6cf0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-897673308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3052ad0ca90d483284dd52edd3a79fbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a82218-b0", "ovs_interfaceid": "72a82218-b019-41c8-a988-4c37a5e8d134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG os_vif [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a82218-b0, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:42 user nova-compute[73079]: INFO os_vif [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:fa:77,bridge_name='br-int',has_traffic_filtering=True,id=72a82218-b019-41c8-a988-4c37a5e8d134,network=Network(f81db18d-4b60-4c59-9703-00f2a5e6cf0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a82218-b0')
Aug 17 14:53:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Deleting instance files /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d_del
Aug 17 14:53:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Deletion of /opt/stack/data/nova/instances/30babe22-af5d-486e-b29b-d82aa03b070d_del complete
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: 27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:42 user nova-compute[73079]: INFO nova.compute.manager [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 14:53:42 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:53:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-27ad4ea6-d144-4936-90af-73058f811e5d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port 27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-fd0b665f-caaf-474f-9aea-cbbc13856dc9 req-72d8d341-9de6-47f2-94cf-09a690698fa4 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-vif-unplugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fd0b665f-caaf-474f-9aea-cbbc13856dc9 req-72d8d341-9de6-47f2-94cf-09a690698fa4 service nova] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fd0b665f-caaf-474f-9aea-cbbc13856dc9 req-72d8d341-9de6-47f2-94cf-09a690698fa4 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fd0b665f-caaf-474f-9aea-cbbc13856dc9 req-72d8d341-9de6-47f2-94cf-09a690698fa4 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-fd0b665f-caaf-474f-9aea-cbbc13856dc9 req-72d8d341-9de6-47f2-94cf-09a690698fa4 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] No waiting events found dispatching network-vif-unplugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-fd0b665f-caaf-474f-9aea-cbbc13856dc9 req-72d8d341-9de6-47f2-94cf-09a690698fa4 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-vif-unplugged-72a82218-b019-41c8-a988-4c37a5e8d134 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:53:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:44 user nova-compute[73079]: INFO nova.compute.manager [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Detaching volume 4aa6e2e9-15ed-4d96-994d-fc6879369429
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:44 user nova-compute[73079]: INFO nova.virt.block_device [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Attempting to driver detach volume 4aa6e2e9-15ed-4d96-994d-fc6879369429 from mountpoint /dev/vdb
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Attempting to detach device vdb from instance 1bbf6615-32dd-41eb-a14c-685476f49c5b from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:53:44 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:44 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:53:44 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:53:44 user nova-compute[73079]:   <serial>4aa6e2e9-15ed-4d96-994d-fc6879369429</serial>
Aug 17 14:53:44 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:53:44 user nova-compute[73079]: </disk>
Aug 17 14:53:44 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-dd482be6-1cb0-439b-b987-a0e065f7df10. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully detached device vdb from instance 1bbf6615-32dd-41eb-a14c-685476f49c5b from the persistent domain config.
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1bbf6615-32dd-41eb-a14c-685476f49c5b from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:53:44 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:53:44 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:53:44 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:53:44 user nova-compute[73079]:   <serial>4aa6e2e9-15ed-4d96-994d-fc6879369429</serial>
Aug 17 14:53:44 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:53:44 user nova-compute[73079]: </disk>
Aug 17 14:53:44 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284024.8808625, 1bbf6615-32dd-41eb-a14c-685476f49c5b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:53:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully detached device vdb from instance 1bbf6615-32dd-41eb-a14c-685476f49c5b from the live domain config.
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRdgZTqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:44 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca3f46-6c72-4bd5-8e6a-ca33ef8f537a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5b7a39-8bcf-4ed8-8121-a14b18ed08d2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 (non-flash)
Aug 17 14:53:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e85479a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75ae1e1-407a-4f80-b418-a5da22224f13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:44 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Took 2.69 seconds to deallocate network for instance.
Aug 17 14:53:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-131b1dd0-8dcc-49b1-9b3d-12d059e06853 req-73ef7405-067c-468c-9ae5-e9bb26453821 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-vif-deleted-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fedfb8-679c-48f7-b082-a2689459d616]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baf92ae-4e2c-4c77-bf82-a497dbff4be3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac3c1d-51e2-4159-bafa-08892f73c07b]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dbb86f-d651-401c-8b8d-b1063dc05d6b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c833d6b-8708-4d20-a75d-74f72b20284c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260]
Aug 17 14:53:45 user nova-compute[73079]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429, portal: 172.16.0.220,3260] successful.
Aug 17 14:53:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa6e2e9-15ed-4d96-994d-fc6879369429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cada53-b1e0-471f-8294-42c49b54d391]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46d72c60-3547-4a23-bbac-a68245520770 req-e204bbc6-0c8f-4f33-93e2-dca4568f4e1a service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== disconnect_volume: return (340ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.433s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-d8ed6892-a9cc-4354-8b33-35c98d05c029. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-a62269e3-c25a-4ba4-8b2d-cfdecd2897a1 req-f9e6245a-c72d-4aa7-b168-08c0c6cc3a92 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received event network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a62269e3-c25a-4ba4-8b2d-cfdecd2897a1 req-f9e6245a-c72d-4aa7-b168-08c0c6cc3a92 service nova] Acquiring lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a62269e3-c25a-4ba4-8b2d-cfdecd2897a1 req-f9e6245a-c72d-4aa7-b168-08c0c6cc3a92 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a62269e3-c25a-4ba4-8b2d-cfdecd2897a1 req-f9e6245a-c72d-4aa7-b168-08c0c6cc3a92 service nova] Lock "30babe22-af5d-486e-b29b-d82aa03b070d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-a62269e3-c25a-4ba4-8b2d-cfdecd2897a1 req-f9e6245a-c72d-4aa7-b168-08c0c6cc3a92 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] No waiting events found dispatching network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:53:45 user nova-compute[73079]: WARNING nova.compute.manager [req-a62269e3-c25a-4ba4-8b2d-cfdecd2897a1 req-f9e6245a-c72d-4aa7-b168-08c0c6cc3a92 service nova] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Received unexpected event network-vif-plugged-72a82218-b019-41c8-a988-4c37a5e8d134 for instance with vm_state deleted and task_state None.
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:53:45 user nova-compute[73079]: INFO nova.compute.claims [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Claim successful on node user
Aug 17 14:53:45 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Deleted allocations for instance 30babe22-af5d-486e-b29b-d82aa03b070d
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: 50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9b7ef9f8-3199-4f64-a328-18096e733931 tempest-AttachVolumeTestJSON-831896009 tempest-AttachVolumeTestJSON-831896009-project-member] Lock "30babe22-af5d-486e-b29b-d82aa03b070d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.513s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:45 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-15a643b5-9f29-4f5c-b28a-8e22fa89bed7 req-8f78c9fc-80ce-4db3-bba5-11a75a9f8db4 service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:53:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:46 user nova-compute[73079]: INFO nova.virt.block_device [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Booting with blank volume at /dev/vda
Aug 17 14:53:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d4be8ee7-e12f-4385-a717-4f544829ea4a tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.092s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.policy [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f67004af6654b5d80924a5c502a74f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd4ad5f2eb4e728a71908d32d353d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: 9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284012.0057127, 67fcd60a-d9b7-45e3-b8df-56df69011831 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:47 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] VM Stopped (Lifecycle Event)
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5cdd2781-8531-464e-98ef-61b46bf72b67 None None] [instance: 67fcd60a-d9b7-45e3-b8df-56df69011831] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Successfully created port: 6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port 50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Successfully updated port: 85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-9251297b-0b58-4ea0-beec-283dcc2aa4bf. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port 9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-39f59701-be2b-4111-9f9b-def20878bcfe req-81e735f9-e9ca-4ce9-be9d-ea0b1a48ec65 service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Successfully updated port: 6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-changed-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Refreshing instance network info cache due to event network-changed-6f8bcd51-97dc-4aef-980d-c3288e4f78ac. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance network_info: |[{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Refreshing network info cache for port 6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-85fae322-4bb1-4dae-bbcf-452e5d492bb7. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updated VIF entry in instance network info cache for port 6f8bcd51-97dc-4aef-980d-c3288e4f78ac. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:53:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-038b7455-3e11-4bd3-9e34-ece47137a6d2 req-1b84a9dd-4c7a-42ca-8aa7-5508774709d0 service nova] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:51 user nova-compute[73079]: INFO nova.virt.block_device [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Booting with volume 8e702358-0c77-4cdc-b51d-e89e96a13d9b at /dev/vdb
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.utils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [{"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b187a-64dd-42ac-88bb-c9a18bbf8b09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance network_info: |[{"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port 85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[db946703-fb5f-46af-a397-b4d744bec9a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d0c996-47f8-49e9-9ee8-fb9f72f4b22d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e812f6-7b99-4247-826e-16b81afc4020]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:51 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de91717-0631-418f-acd4-539fffa4208e]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.utils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating existing volume attachment record: e01d9e79-01da-4786-86a4-f1e6f7fcf72b {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG os_brick.utils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:53:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbee86b-3deb-470d-89f5-24d72197a14b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d324e303-8290-40c1-959a-d92c099e9bdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4fcb9b-e580-4924-8752-c451d3b03a09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa24b8e2-fa16-46da-a657-5d13ad5f96a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:53:52 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db7368-ea0a-46d8-8636-532b2809152f]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG os_brick.utils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating existing volume attachment record: 5a84e20f-d465-4d70-b632-9fc57e12bc56 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updated VIF entry in instance network info cache for port 85fae322-4bb1-4dae-bbcf-452e5d492bb7. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [{"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:53:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1c4e3f66-8b2e-4462-8375-9ad8c19f411c req-318e666e-5bb4-4585-be35-296c9a2828ca service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:53:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284022.1349723, 30babe22-af5d-486e-b29b-d82aa03b070d => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:53:57 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] VM Stopped (Lifecycle Event)
Aug 17 14:53:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-559b55f0-0a1c-4454-91a6-6e31f7a1418f None None] [instance: 30babe22-af5d-486e-b29b-d82aa03b070d] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:53:57 user nova-compute[73079]: INFO nova.compute.claims [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Claim successful on node user
Aug 17 14:53:57 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:53:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:53:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.policy [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5be2577e42ea4028a65428b5f86520b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78138dae3ab40718afcfc642e8af731', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:53:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Creating image(s)
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "/opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "/opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk 1073741824" returned: 0 in 0.047s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:53:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Successfully created port: d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Cannot resize image /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'migration_context' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Ensure instance console log exists: /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Successfully updated port: d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquired lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-changed-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Refreshing instance network info cache due to event network-changed-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] Acquiring lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:53:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating instance_info_cache with network_info: [{"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Releasing lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Instance network_info: |[{"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] Acquired lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Refreshing network info cache for port d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Start _get_guest_xml network_info=[{"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:54:00 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:00 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1571305615',display_name='tempest-SnapshotDataIntegrityTests-server-1571305615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1571305615',id=27,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKuyaeYCDLwXPtmpDtFbuC3Atk8OKxMDiH+g+Cgr4ikDkrS3MEOhJc8edKcqkTKDOOPcuj9CPA7OVtme5kqBWJ82AELGh+HtEyLQ2SA0cjDu0myPqL2YDNihFufSv9WWA==',key_name='tempest-keypair-1191235343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b78138dae3ab40718afcfc642e8af731',ramdisk_id='',reservation_id='r-7z8f0ms8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-521184253',owner_user_name='tempest-SnapshotDataIntegrityTests-521184253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5be2577e42ea4028a65428b5f86520b6',uuid=e1bec80a-f4a5-4df0-b02d-660865f4e0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Converting VIF {"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'pci_devices' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:54:00 user nova-compute[73079]:   <uuid>e1bec80a-f4a5-4df0-b02d-660865f4e0a7</uuid>
Aug 17 14:54:00 user nova-compute[73079]:   <name>instance-0000001b</name>
Aug 17 14:54:00 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:54:00 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:54:00 user nova-compute[73079]:   <metadata>
Aug 17 14:54:00 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:54:00 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:54:00 user nova-compute[73079]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1571305615</nova:name>
Aug 17 14:54:00 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:54:00</nova:creationTime>
Aug 17 14:54:00 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:54:00 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:54:00 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:54:00 user nova-compute[73079]:       <nova:owner>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:user uuid="5be2577e42ea4028a65428b5f86520b6">tempest-SnapshotDataIntegrityTests-521184253-project-member</nova:user>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:project uuid="b78138dae3ab40718afcfc642e8af731">tempest-SnapshotDataIntegrityTests-521184253</nova:project>
Aug 17 14:54:00 user nova-compute[73079]:       </nova:owner>
Aug 17 14:54:00 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:54:00 user nova-compute[73079]:       <nova:ports>
Aug 17 14:54:00 user nova-compute[73079]:         <nova:port uuid="d65468eb-accc-4f0a-8fdb-5fdf8020f7b5">
Aug 17 14:54:00 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 14:54:00 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:00 user nova-compute[73079]:       </nova:ports>
Aug 17 14:54:00 user nova-compute[73079]:     </nova:instance>
Aug 17 14:54:00 user nova-compute[73079]:   </metadata>
Aug 17 14:54:00 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:54:00 user nova-compute[73079]:     <system>
Aug 17 14:54:00 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:54:00 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:54:00 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:54:00 user nova-compute[73079]:       <entry name="serial">e1bec80a-f4a5-4df0-b02d-660865f4e0a7</entry>
Aug 17 14:54:00 user nova-compute[73079]:       <entry name="uuid">e1bec80a-f4a5-4df0-b02d-660865f4e0a7</entry>
Aug 17 14:54:00 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:54:00 user nova-compute[73079]:     </system>
Aug 17 14:54:00 user nova-compute[73079]:   </sysinfo>
Aug 17 14:54:00 user nova-compute[73079]:   <os>
Aug 17 14:54:00 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:54:00 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:54:00 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:54:00 user nova-compute[73079]:   </os>
Aug 17 14:54:00 user nova-compute[73079]:   <features>
Aug 17 14:54:00 user nova-compute[73079]:     <acpi/>
Aug 17 14:54:00 user nova-compute[73079]:     <apic/>
Aug 17 14:54:00 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:54:00 user nova-compute[73079]:   </features>
Aug 17 14:54:00 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:54:00 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:54:00 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:54:00 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:54:00 user nova-compute[73079]:   </clock>
Aug 17 14:54:00 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:54:00 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:54:00 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:54:00 user nova-compute[73079]:   </cpu>
Aug 17 14:54:00 user nova-compute[73079]:   <devices>
Aug 17 14:54:00 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:54:00 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:54:00 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk"/>
Aug 17 14:54:00 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:54:00 user nova-compute[73079]:     </disk>
Aug 17 14:54:00 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:00 user nova-compute[73079]:       <mac address="fa:16:3e:ca:e5:50"/>
Aug 17 14:54:00 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:00 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:00 user nova-compute[73079]:       <target dev="tapd65468eb-ac"/>
Aug 17 14:54:00 user nova-compute[73079]:     </interface>
Aug 17 14:54:00 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:54:00 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/console.log" append="off"/>
Aug 17 14:54:00 user nova-compute[73079]:     </serial>
Aug 17 14:54:00 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:54:00 user nova-compute[73079]:     <video>
Aug 17 14:54:00 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:00 user nova-compute[73079]:     </video>
Aug 17 14:54:00 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:54:00 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:54:00 user nova-compute[73079]:     </rng>
Aug 17 14:54:00 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:54:00 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:54:00 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:54:00 user nova-compute[73079]:     </memballoon>
Aug 17 14:54:00 user nova-compute[73079]:   </devices>
Aug 17 14:54:00 user nova-compute[73079]: </domain>
Aug 17 14:54:00 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1571305615',display_name='tempest-SnapshotDataIntegrityTests-server-1571305615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1571305615',id=27,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKuyaeYCDLwXPtmpDtFbuC3Atk8OKxMDiH+g+Cgr4ikDkrS3MEOhJc8edKcqkTKDOOPcuj9CPA7OVtme5kqBWJ82AELGh+HtEyLQ2SA0cjDu0myPqL2YDNihFufSv9WWA==',key_name='tempest-keypair-1191235343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b78138dae3ab40718afcfc642e8af731',ramdisk_id='',reservation_id='r-7z8f0ms8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-521184253',owner_user_name='tempest-SnapshotDataIntegrityTests-521184253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5be2577e42ea4028a65428b5f86520b6',uuid=e1bec80a-f4a5-4df0-b02d-660865f4e0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Converting VIF {"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG os_vif [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd65468eb-ac, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd65468eb-ac, col_values=(('external_ids', {'iface-id': 'd65468eb-accc-4f0a-8fdb-5fdf8020f7b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:e5:50', 'vm-uuid': 'e1bec80a-f4a5-4df0-b02d-660865f4e0a7'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:00 user nova-compute[73079]: INFO os_vif [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac')
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No VIF found with MAC fa:16:3e:ca:e5:50, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updated VIF entry in instance network info cache for port d65468eb-accc-4f0a-8fdb-5fdf8020f7b5. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating instance_info_cache with network_info: [{"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c054b4e-82af-402c-9ac7-8db352d53bd5 req-ed41d56e-9867-46ed-b59d-5c394e26165b service nova] Releasing lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:54:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-cc2c7866-4d5c-4b3b-9b6e-bca31556fe8f req-10b17f21-b2d0-4ef1-983c-de0e3d97421e service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cc2c7866-4d5c-4b3b-9b6e-bca31556fe8f req-10b17f21-b2d0-4ef1-983c-de0e3d97421e service nova] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cc2c7866-4d5c-4b3b-9b6e-bca31556fe8f req-10b17f21-b2d0-4ef1-983c-de0e3d97421e service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cc2c7866-4d5c-4b3b-9b6e-bca31556fe8f req-10b17f21-b2d0-4ef1-983c-de0e3d97421e service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-cc2c7866-4d5c-4b3b-9b6e-bca31556fe8f req-10b17f21-b2d0-4ef1-983c-de0e3d97421e service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] No waiting events found dispatching network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:02 user nova-compute[73079]: WARNING nova.compute.manager [req-cc2c7866-4d5c-4b3b-9b6e-bca31556fe8f req-10b17f21-b2d0-4ef1-983c-de0e3d97421e service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received unexpected event network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 for instance with vm_state building and task_state spawning.
Aug 17 14:54:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284044.037969, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] VM Resumed (Lifecycle Event)
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Instance spawned successfully.
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284044.0394135, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] VM Started (Lifecycle Event)
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-8d0c1446-6f18-4709-95e0-fe4bfd01b2a7 req-12e23d32-906d-451d-8fc7-9592d3a8e7db service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8d0c1446-6f18-4709-95e0-fe4bfd01b2a7 req-12e23d32-906d-451d-8fc7-9592d3a8e7db service nova] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8d0c1446-6f18-4709-95e0-fe4bfd01b2a7 req-12e23d32-906d-451d-8fc7-9592d3a8e7db service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8d0c1446-6f18-4709-95e0-fe4bfd01b2a7 req-12e23d32-906d-451d-8fc7-9592d3a8e7db service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-8d0c1446-6f18-4709-95e0-fe4bfd01b2a7 req-12e23d32-906d-451d-8fc7-9592d3a8e7db service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] No waiting events found dispatching network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:04 user nova-compute[73079]: WARNING nova.compute.manager [req-8d0c1446-6f18-4709-95e0-fe4bfd01b2a7 req-12e23d32-906d-451d-8fc7-9592d3a8e7db service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received unexpected event network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 for instance with vm_state building and task_state spawning.
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 17 14:54:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:04 user nova-compute[73079]: INFO nova.compute.manager [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Took 6.59 seconds to build instance.
Aug 17 14:54:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9495a8e0-1f23-4797-bf20-90d1fb68612e tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.699s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:05 user nova-compute[73079]: INFO nova.virt.block_device [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Booting with volume 79ec9e1e-3aa4-4202-8dc8-9367a7970d55 at /dev/vdc
Aug 17 14:54:05 user nova-compute[73079]: DEBUG os_brick.utils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fabec5-4dfb-493d-bedc-77f0baeea5ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[472a97bd-e107-44bb-a6c1-396cb67db037]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64692ede-ecd9-42d0-b99b-fd2b3d18ff8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e71a9-77bf-4386-9864-2a8cdd125afa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:54:05 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:54:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[41130f77-ac35-4051-8c18-ed7450cdc611]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG os_brick.utils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:54:05 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating existing volume attachment record: 493d2f97-bcf1-4d9a-9d06-2660e9063dd8 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:54:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:54:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.345s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8258MB free_disk=25.510822296142578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:54:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1bbf6615-32dd-41eb-a14c-685476f49c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance f25d4a41-0990-48b1-a2a9-fd3849526044 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3ef3f716-ed73-4478-b367-37ac0377df63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:54:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 14:54:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:54:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Creating image(s)
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Ensure instance console log exists: /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Start _get_guest_xml network_info=[{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5a84e20f-d465-4d70-b632-9fc57e12bc56', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '168eb979-11c1-4643-a2e2-b160cbc5f150', 'attached_at': '', 'detached_at': '', 'volume_id': '353cf1f3-e72b-47e3-8f9a-784d15af77e0', 'serial': '353cf1f3-e72b-47e3-8f9a-784d15af77e0'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:54:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:54:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:20 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[311114a9-d1c8-43dc-9c1d-511c7f374f89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:54:20 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[30565601-cfb6-41b4-88e9-97aaba093d2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0] added
Aug 17 14:54:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[621acad8-dec8-4877-983f-f5c37af179b8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6893777c-f345-438a-b609-c7bd5619c411]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYJnThqC {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYJnThqC" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5285d8-f163-4d01-b5cf-8501e0ff3c05]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gYJnThqC'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c29846-fdfc-4d4b-bf3e-60b1b193eaf6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ffa9e-4baa-4e6c-8052-131713e5bf12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 14:54:20 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 14:54:20 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 14:54:20 user nova-compute[73079]: 
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6609ed52-c542-4ec9-ad1e-28bfeaf29b09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260]
Aug 17 14:54:20 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260] successful.
Aug 17 14:54:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36fc204-3ad7-4e2f-ba13-2b3ece84d2e5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea401bf7-7650-4ee8-b377-b3dc45b7d78b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec014d6d-f9ee-46d2-889d-88408ecc7679]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:54:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26339633165336664', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339633165336664', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720781670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720781670',id=26,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-cuol53ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:46Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=168eb979-11c1-4643-a2e2-b160cbc5f150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.objects.instance [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'pci_devices' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:54:21 user nova-compute[73079]:   <uuid>168eb979-11c1-4643-a2e2-b160cbc5f150</uuid>
Aug 17 14:54:21 user nova-compute[73079]:   <name>instance-0000001a</name>
Aug 17 14:54:21 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:54:21 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:54:21 user nova-compute[73079]:   <metadata>
Aug 17 14:54:21 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:54:21 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:54:21 user nova-compute[73079]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1720781670</nova:name>
Aug 17 14:54:21 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:54:20</nova:creationTime>
Aug 17 14:54:21 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:54:21 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:54:21 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:54:21 user nova-compute[73079]:       <nova:owner>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:user uuid="5f67004af6654b5d80924a5c502a74f2">tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member</nova:user>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:project uuid="0edd4ad5f2eb4e728a71908d32d353d5">tempest-ServerBootFromVolumeStableRescueTest-2072772980</nova:project>
Aug 17 14:54:21 user nova-compute[73079]:       </nova:owner>
Aug 17 14:54:21 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:54:21 user nova-compute[73079]:       <nova:ports>
Aug 17 14:54:21 user nova-compute[73079]:         <nova:port uuid="6f8bcd51-97dc-4aef-980d-c3288e4f78ac">
Aug 17 14:54:21 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 14:54:21 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:21 user nova-compute[73079]:       </nova:ports>
Aug 17 14:54:21 user nova-compute[73079]:     </nova:instance>
Aug 17 14:54:21 user nova-compute[73079]:   </metadata>
Aug 17 14:54:21 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:54:21 user nova-compute[73079]:     <system>
Aug 17 14:54:21 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:54:21 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:54:21 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:54:21 user nova-compute[73079]:       <entry name="serial">168eb979-11c1-4643-a2e2-b160cbc5f150</entry>
Aug 17 14:54:21 user nova-compute[73079]:       <entry name="uuid">168eb979-11c1-4643-a2e2-b160cbc5f150</entry>
Aug 17 14:54:21 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:54:21 user nova-compute[73079]:     </system>
Aug 17 14:54:21 user nova-compute[73079]:   </sysinfo>
Aug 17 14:54:21 user nova-compute[73079]:   <os>
Aug 17 14:54:21 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:54:21 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:54:21 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:54:21 user nova-compute[73079]:   </os>
Aug 17 14:54:21 user nova-compute[73079]:   <features>
Aug 17 14:54:21 user nova-compute[73079]:     <acpi/>
Aug 17 14:54:21 user nova-compute[73079]:     <apic/>
Aug 17 14:54:21 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:54:21 user nova-compute[73079]:   </features>
Aug 17 14:54:21 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:54:21 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:54:21 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:54:21 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:54:21 user nova-compute[73079]:   </clock>
Aug 17 14:54:21 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:54:21 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:54:21 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:54:21 user nova-compute[73079]:   </cpu>
Aug 17 14:54:21 user nova-compute[73079]:   <devices>
Aug 17 14:54:21 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:54:21 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:54:21 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 14:54:21 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:54:21 user nova-compute[73079]:       <serial>353cf1f3-e72b-47e3-8f9a-784d15af77e0</serial>
Aug 17 14:54:21 user nova-compute[73079]:     </disk>
Aug 17 14:54:21 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:21 user nova-compute[73079]:       <mac address="fa:16:3e:0d:99:f0"/>
Aug 17 14:54:21 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:21 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:21 user nova-compute[73079]:       <target dev="tap6f8bcd51-97"/>
Aug 17 14:54:21 user nova-compute[73079]:     </interface>
Aug 17 14:54:21 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:54:21 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/console.log" append="off"/>
Aug 17 14:54:21 user nova-compute[73079]:     </serial>
Aug 17 14:54:21 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:54:21 user nova-compute[73079]:     <video>
Aug 17 14:54:21 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:21 user nova-compute[73079]:     </video>
Aug 17 14:54:21 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:54:21 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:54:21 user nova-compute[73079]:     </rng>
Aug 17 14:54:21 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:54:21 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:54:21 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:54:21 user nova-compute[73079]:     </memballoon>
Aug 17 14:54:21 user nova-compute[73079]:   </devices>
Aug 17 14:54:21 user nova-compute[73079]: </domain>
Aug 17 14:54:21 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720781670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720781670',id=26,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-cuol53ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:46Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=168eb979-11c1-4643-a2e2-b160cbc5f150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG os_vif [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f8bcd51-97, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f8bcd51-97, col_values=(('external_ids', {'iface-id': '6f8bcd51-97dc-4aef-980d-c3288e4f78ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:99:f0', 'vm-uuid': '168eb979-11c1-4643-a2e2-b160cbc5f150'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:21 user nova-compute[73079]: INFO os_vif [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97')
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No VIF found with MAC fa:16:3e:0d:99:f0, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:54:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-245aa6b4-861b-4f24-a54f-a8e88eeb0b0c req-9a91e3c4-9007-466c-9d4a-fa29b9e36b78 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-245aa6b4-861b-4f24-a54f-a8e88eeb0b0c req-9a91e3c4-9007-466c-9d4a-fa29b9e36b78 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-245aa6b4-861b-4f24-a54f-a8e88eeb0b0c req-9a91e3c4-9007-466c-9d4a-fa29b9e36b78 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-245aa6b4-861b-4f24-a54f-a8e88eeb0b0c req-9a91e3c4-9007-466c-9d4a-fa29b9e36b78 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-245aa6b4-861b-4f24-a54f-a8e88eeb0b0c req-9a91e3c4-9007-466c-9d4a-fa29b9e36b78 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:23 user nova-compute[73079]: WARNING nova.compute.manager [req-245aa6b4-861b-4f24-a54f-a8e88eeb0b0c req-9a91e3c4-9007-466c-9d4a-fa29b9e36b78 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state building and task_state spawning.
Aug 17 14:54:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284065.0011487, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Resumed (Lifecycle Event)
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance spawned successfully.
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284065.0025632, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Started (Lifecycle Event)
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:25 user nova-compute[73079]: INFO nova.compute.manager [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Took 39.98 seconds to build instance.
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-902afd41-034e-443b-8009-79d0da4fd98e req-b1f24ba7-634b-45fa-ab08-f4b9babd5edb service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-902afd41-034e-443b-8009-79d0da4fd98e req-b1f24ba7-634b-45fa-ab08-f4b9babd5edb service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-902afd41-034e-443b-8009-79d0da4fd98e req-b1f24ba7-634b-45fa-ab08-f4b9babd5edb service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-902afd41-034e-443b-8009-79d0da4fd98e req-b1f24ba7-634b-45fa-ab08-f4b9babd5edb service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-902afd41-034e-443b-8009-79d0da4fd98e req-b1f24ba7-634b-45fa-ab08-f4b9babd5edb service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:25 user nova-compute[73079]: WARNING nova.compute.manager [req-902afd41-034e-443b-8009-79d0da4fd98e req-b1f24ba7-634b-45fa-ab08-f4b9babd5edb service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state active and task_state None.
Aug 17 14:54:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3a444995-aa57-4ab0-a6ba-5f639f75f82e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.108s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:54:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Creating image(s)
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Ensure instance console log exists: /opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Start _get_guest_xml network_info=[{"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '2dba358e-be10-4a76-9302-8bf047576be5', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDOEpynG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ef3f716-ed73-4478-b367-37ac0377df63', 'attached_at': '', 'detached_at': '', 'volume_id': '003d8b35-b4f7-4883-921e-6254261f6228', 'serial': '003d8b35-b4f7-4883-921e-6254261f6228'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'e01d9e79-01da-4786-86a4-f1e6f7fcf72b', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XarGDIvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ef3f716-ed73-4478-b367-37ac0377df63', 'attached_at': '', 'detached_at': '', 'volume_id': '8e702358-0c77-4cdc-b51d-e89e96a13d9b', 'serial': '8e702358-0c77-4cdc-b51d-e89e96a13d9b'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '493d2f97-bcf1-4d9a-9d06-2660e9063dd8', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOXpCdED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ef3f716-ed73-4478-b367-37ac0377df63', 'attached_at': '', 'detached_at': '', 'volume_id': '79ec9e1e-3aa4-4202-8dc8-9367a7970d55', 'serial': '79ec9e1e-3aa4-4202-8dc8-9367a7970d55'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:54:34 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:34 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDOEpynG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:54:34 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:34 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:34 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d4594-d847-45f5-a3e4-3b2a5fe8f0e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:54:34 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d993c4aa-97e5-4cee-b921-6c093940d0cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228] added
Aug 17 14:54:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a808edcb-7ea2-4bec-96fa-480c2b25dfa4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81d674f-deb6-4f6c-b62a-2a111632fa59]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDOEpynG {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDOEpynG" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4394e-a56f-4bfd-a9bd-a0e1dc9c4f39]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDOEpynG'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c989a-51c2-426e-8f8c-f1aef99eef75]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15cecd-64ab-498b-8f4b-fa64b3848e15]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e6fba-7584-4efd-9d8a-2662aaa1590b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260]
Aug 17 14:54:34 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260] successful.
Aug 17 14:54:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[65286c60-cb20-4df7-9048-53c116f51597]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b46883-608b-4c8a-a875-29b5777ea087]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:34 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:34 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[210da8df-63ae-4a8e-8b65-5ddb47b79dee]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:34 user nova-compute[73079]: INFO nova.compute.manager [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Terminating instance
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-bc448a57-bdde-427d-893f-704eaee2dcf8 req-473f99ac-9ac3-456b-8481-51b89a647073 service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-vif-unplugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bc448a57-bdde-427d-893f-704eaee2dcf8 req-473f99ac-9ac3-456b-8481-51b89a647073 service nova] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bc448a57-bdde-427d-893f-704eaee2dcf8 req-473f99ac-9ac3-456b-8481-51b89a647073 service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bc448a57-bdde-427d-893f-704eaee2dcf8 req-473f99ac-9ac3-456b-8481-51b89a647073 service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-bc448a57-bdde-427d-893f-704eaee2dcf8 req-473f99ac-9ac3-456b-8481-51b89a647073 service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] No waiting events found dispatching network-vif-unplugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-bc448a57-bdde-427d-893f-704eaee2dcf8 req-473f99ac-9ac3-456b-8481-51b89a647073 service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-vif-unplugged-abb92137-be34-4f1d-b0d4-72f3ba157584 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:54:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Instance destroyed successfully.
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'resources' on Instance uuid 1bbf6615-32dd-41eb-a14c-685476f49c5b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1257922660',display_name='tempest-AttachVolumeNegativeTest-server-1257922660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1257922660',id=18,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqzxGJ0jWB4mCs2Td5ldb9tB5uyj4309CRlVfTVVSWaP8r60jz4P/T0NIIjsQ8vuxvg8cKjOFFGtzQ9ojV4Zesift1Kc0HDJ/jHmSiXlxVuj84R/t5nI3ytQ3CmfxY2rw==',key_name='tempest-keypair-1401690174',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-i39arlm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=1bbf6615-32dd-41eb-a14c-685476f49c5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "abb92137-be34-4f1d-b0d4-72f3ba157584", "address": "fa:16:3e:04:fd:55", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb92137-be", "ovs_interfaceid": "abb92137-be34-4f1d-b0d4-72f3ba157584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_vif [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabb92137-be, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:35 user nova-compute[73079]: INFO os_vif [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:fd:55,bridge_name='br-int',has_traffic_filtering=True,id=abb92137-be34-4f1d-b0d4-72f3ba157584,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb92137-be')
Aug 17 14:54:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Deleting instance files /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b_del
Aug 17 14:54:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Deletion of /opt/stack/data/nova/instances/1bbf6615-32dd-41eb-a14c-685476f49c5b_del complete
Aug 17 14:54:35 user nova-compute[73079]: INFO nova.compute.manager [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDOEpynG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23265326338303566', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265326338303566', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XarGDIvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:54:35 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:35 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:35 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fb7009-7bf3-48fd-a033-5ef17ffe5dca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:54:35 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[666fd19e-83bf-43ae-844b-826fc024f9c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b] added
Aug 17 14:54:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42fe36-7acf-4d5b-a5f8-46bf6cd62690]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51d4483-850f-4e2d-89fb-fde380d338f6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XarGDIvm {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XarGDIvm" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[163e9648-f2bb-4765-99ea-dcdad0521f27]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XarGDIvm'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6902a2f1-2e68-492b-a15c-53f3eb888643]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff9ad4-b9ce-46a4-8122-c1c72f3a1e62]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1062cb8f-2583-4742-94ac-2dca1e982404]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260]
Aug 17 14:54:35 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260] successful.
Aug 17 14:54:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c10825c-f359-4823-b05c-97d6b5b5f0f9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085e03c-fc7c-4438-8a11-9264aa04cfb8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:54:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:35 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:54:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6435743-19c2-4e67-bd59-b371317adeb0]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:54:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XarGDIvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:36 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Took 1.35 seconds to deallocate network for instance.
Aug 17 14:54:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-7e6ae9fe-68db-48bb-a642-63ff64c99023 req-9810d5d4-3bb1-40e8-a60e-955913ce7a5f service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-vif-deleted-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-170b682b-8489-4515-9828-e1cb3fe4219f req-cc31480b-dab1-430b-8ade-5d0e88d64bdc service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received event network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-170b682b-8489-4515-9828-e1cb3fe4219f req-cc31480b-dab1-430b-8ade-5d0e88d64bdc service nova] Acquiring lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-170b682b-8489-4515-9828-e1cb3fe4219f req-cc31480b-dab1-430b-8ade-5d0e88d64bdc service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-170b682b-8489-4515-9828-e1cb3fe4219f req-cc31480b-dab1-430b-8ade-5d0e88d64bdc service nova] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-170b682b-8489-4515-9828-e1cb3fe4219f req-cc31480b-dab1-430b-8ade-5d0e88d64bdc service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] No waiting events found dispatching network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:36 user nova-compute[73079]: WARNING nova.compute.manager [req-170b682b-8489-4515-9828-e1cb3fe4219f req-cc31480b-dab1-430b-8ade-5d0e88d64bdc service nova] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Received unexpected event network-vif-plugged-abb92137-be34-4f1d-b0d4-72f3ba157584 for instance with vm_state deleted and task_state None.
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26436353561626537', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436353561626537', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOXpCdED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:54:36 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:36 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:54:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:54:36 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:54:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45d593-f4a9-40b9-b34d-e4da562df06c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:54:37 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b907b3d-9adc-4dfc-8d31-e318978e5a05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55] added
Aug 17 14:54:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bda49ac-81f6-463c-bab3-6c566d308cc8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f73d4c-ccf1-4558-9642-9c759b4ab53d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOXpCdED {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOXpCdED" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0920050-82bb-4f12-b0ad-6d808befa2e6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MOXpCdED'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af698c-8216-48ce-bf88-649e1a5192f6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9604e9-bcf6-4e3c-b800-5312ed7a855b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:54:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:54:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Deleted allocations for instance 1bbf6615-32dd-41eb-a14c-685476f49c5b
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab35b6-83e4-492f-b96f-d55b52ecd1ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260]
Aug 17 14:54:37 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260] successful.
Aug 17 14:54:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a56c7-29d3-4299-9a4d-c9cd571af050]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e22fe-77a3-4fe3-9294-cc43b1a9a949]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:54:37 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:54:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2dd257a8-1be4-4763-8060-73f4e26a2248 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "1bbf6615-32dd-41eb-a14c-685476f49c5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.100s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3801cbf-afd7-4109-a83d-449f6ab40ca8]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:54:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOXpCdED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26131666330633934', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131666330633934', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ef3f716-ed73-4478-b367-37ac0377df63 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:54:38 user nova-compute[73079]:   <uuid>3ef3f716-ed73-4478-b367-37ac0377df63</uuid>
Aug 17 14:54:38 user nova-compute[73079]:   <name>instance-00000019</name>
Aug 17 14:54:38 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:54:38 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:54:38 user nova-compute[73079]:   <metadata>
Aug 17 14:54:38 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:54:38 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:54:38 user nova-compute[73079]:       <nova:name>tempest-device-tagging-server-357057559</nova:name>
Aug 17 14:54:38 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:54:34</nova:creationTime>
Aug 17 14:54:38 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:54:38 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:54:38 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:54:38 user nova-compute[73079]:       <nova:owner>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:user uuid="c5f41d1f2aac44178df8d963f84859d8">tempest-TaggedBootDevicesTest_v242-1762857507-project-member</nova:user>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:project uuid="4fbd1df658bf4985a76bd23a1ab2a8a5">tempest-TaggedBootDevicesTest_v242-1762857507</nova:project>
Aug 17 14:54:38 user nova-compute[73079]:       </nova:owner>
Aug 17 14:54:38 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:54:38 user nova-compute[73079]:       <nova:ports>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="fe741116-543b-4c4f-bb8a-93bfa769d439">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="27ad4ea6-d144-4936-90af-73058f811e5d">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="dd482be6-1cb0-439b-b987-a0e065f7df10">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.67" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="d8ed6892-a9cc-4354-8b33-35c98d05c029">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="50304c3c-dfdf-4280-ab43-9db0cd6ca1f4">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="9251297b-0b58-4ea0-beec-283dcc2aa4bf">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:         <nova:port uuid="85fae322-4bb1-4dae-bbcf-452e5d492bb7">
Aug 17 14:54:38 user nova-compute[73079]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 14:54:38 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:38 user nova-compute[73079]:       </nova:ports>
Aug 17 14:54:38 user nova-compute[73079]:     </nova:instance>
Aug 17 14:54:38 user nova-compute[73079]:   </metadata>
Aug 17 14:54:38 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:54:38 user nova-compute[73079]:     <system>
Aug 17 14:54:38 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:54:38 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:54:38 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:54:38 user nova-compute[73079]:       <entry name="serial">3ef3f716-ed73-4478-b367-37ac0377df63</entry>
Aug 17 14:54:38 user nova-compute[73079]:       <entry name="uuid">3ef3f716-ed73-4478-b367-37ac0377df63</entry>
Aug 17 14:54:38 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:54:38 user nova-compute[73079]:     </system>
Aug 17 14:54:38 user nova-compute[73079]:   </sysinfo>
Aug 17 14:54:38 user nova-compute[73079]:   <os>
Aug 17 14:54:38 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:54:38 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:54:38 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:54:38 user nova-compute[73079]:   </os>
Aug 17 14:54:38 user nova-compute[73079]:   <features>
Aug 17 14:54:38 user nova-compute[73079]:     <acpi/>
Aug 17 14:54:38 user nova-compute[73079]:     <apic/>
Aug 17 14:54:38 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:54:38 user nova-compute[73079]:   </features>
Aug 17 14:54:38 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:54:38 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:54:38 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:54:38 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:54:38 user nova-compute[73079]:   </clock>
Aug 17 14:54:38 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:54:38 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:54:38 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:54:38 user nova-compute[73079]:   </cpu>
Aug 17 14:54:38 user nova-compute[73079]:   <devices>
Aug 17 14:54:38 user nova-compute[73079]:     <disk type="file" device="cdrom">
Aug 17 14:54:38 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 14:54:38 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63/disk.config"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="hda" bus="ide"/>
Aug 17 14:54:38 user nova-compute[73079]:     </disk>
Aug 17 14:54:38 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:54:38 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:54:38 user nova-compute[73079]:       <source dev="/dev/sdc"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <serial>003d8b35-b4f7-4883-921e-6254261f6228</serial>
Aug 17 14:54:38 user nova-compute[73079]:     </disk>
Aug 17 14:54:38 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:54:38 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:54:38 user nova-compute[73079]:       <source dev="/dev/sdd"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <serial>8e702358-0c77-4cdc-b51d-e89e96a13d9b</serial>
Aug 17 14:54:38 user nova-compute[73079]:     </disk>
Aug 17 14:54:38 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:54:38 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:54:38 user nova-compute[73079]:       <source dev="/dev/sde"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="vdc" bus="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <serial>79ec9e1e-3aa4-4202-8dc8-9367a7970d55</serial>
Aug 17 14:54:38 user nova-compute[73079]:     </disk>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:85:91:df"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tapfe741116-54"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:cb:d0:45"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tap27ad4ea6-d1"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:ae:ae:7e"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tapdd482be6-1c"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:5f:ee:e5"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tapd8ed6892-a9"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:8d:57:05"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tap50304c3c-df"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:40:d1:b0"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tap9251297b-0b"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:38 user nova-compute[73079]:       <mac address="fa:16:3e:8d:04:4f"/>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:38 user nova-compute[73079]:       <target dev="tap85fae322-4b"/>
Aug 17 14:54:38 user nova-compute[73079]:     </interface>
Aug 17 14:54:38 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:54:38 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63/console.log" append="off"/>
Aug 17 14:54:38 user nova-compute[73079]:     </serial>
Aug 17 14:54:38 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:54:38 user nova-compute[73079]:     <video>
Aug 17 14:54:38 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:38 user nova-compute[73079]:     </video>
Aug 17 14:54:38 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:54:38 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:54:38 user nova-compute[73079]:     </rng>
Aug 17 14:54:38 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:54:38 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:54:38 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:54:38 user nova-compute[73079]:     </memballoon>
Aug 17 14:54:38 user nova-compute[73079]:   </devices>
Aug 17 14:54:38 user nova-compute[73079]: </domain>
Aug 17 14:54:38 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe741116-54, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe741116-54, col_values=(('external_ids', {'iface-id': 'fe741116-543b-4c4f-bb8a-93bfa769d439', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:91:df', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27ad4ea6-d1, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27ad4ea6-d1, col_values=(('external_ids', {'iface-id': '27ad4ea6-d144-4936-90af-73058f811e5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:d0:45', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd482be6-1c, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd482be6-1c, col_values=(('external_ids', {'iface-id': 'dd482be6-1cb0-439b-b987-a0e065f7df10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ae:7e', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8ed6892-a9, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8ed6892-a9, col_values=(('external_ids', {'iface-id': 'd8ed6892-a9cc-4354-8b33-35c98d05c029', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ee:e5', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50304c3c-df, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50304c3c-df, col_values=(('external_ids', {'iface-id': '50304c3c-dfdf-4280-ab43-9db0cd6ca1f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:57:05', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9251297b-0b, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9251297b-0b, col_values=(('external_ids', {'iface-id': '9251297b-0b58-4ea0-beec-283dcc2aa4bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:d1:b0', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:53:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85fae322-4b, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85fae322-4b, col_values=(('external_ids', {'iface-id': '85fae322-4bb1-4dae-bbcf-452e5d492bb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:04:4f', 'vm-uuid': '3ef3f716-ed73-4478-b367-37ac0377df63'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:38 user nova-compute[73079]: INFO os_vif [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b')
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] No BDM found with device name hda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] No VIF found with MAC fa:16:3e:85:91:df, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:54:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] No VIF found with MAC fa:16:3e:8d:57:05, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:54:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Using config drive
Aug 17 14:54:39 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Creating config drive at /opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63/disk.config
Aug 17 14:54:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwjd4au0b {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwjd4au0b" returned: 0 in 0.058s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c4a4c8c-c6bf-484d-8569-378336a6789c req-cee8ebb6-b493-4dc6-b205-cc9223751bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c4a4c8c-c6bf-484d-8569-378336a6789c req-cee8ebb6-b493-4dc6-b205-cc9223751bda service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c4a4c8c-c6bf-484d-8569-378336a6789c req-cee8ebb6-b493-4dc6-b205-cc9223751bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3c4a4c8c-c6bf-484d-8569-378336a6789c req-cee8ebb6-b493-4dc6-b205-cc9223751bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-3c4a4c8c-c6bf-484d-8569-378336a6789c req-cee8ebb6-b493-4dc6-b205-cc9223751bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:40 user nova-compute[73079]: WARNING nova.compute.manager [req-3c4a4c8c-c6bf-484d-8569-378336a6789c req-cee8ebb6-b493-4dc6-b205-cc9223751bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 for instance with vm_state building and task_state spawning.
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-4ead3564-aa98-46e3-b16d-d266f4bdd599 req-783130f3-3d37-4f19-bb00-13d2908b8dd6 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4ead3564-aa98-46e3-b16d-d266f4bdd599 req-783130f3-3d37-4f19-bb00-13d2908b8dd6 service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4ead3564-aa98-46e3-b16d-d266f4bdd599 req-783130f3-3d37-4f19-bb00-13d2908b8dd6 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4ead3564-aa98-46e3-b16d-d266f4bdd599 req-783130f3-3d37-4f19-bb00-13d2908b8dd6 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-4ead3564-aa98-46e3-b16d-d266f4bdd599 req-783130f3-3d37-4f19-bb00-13d2908b8dd6 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:41 user nova-compute[73079]: WARNING nova.compute.manager [req-4ead3564-aa98-46e3-b16d-d266f4bdd599 req-783130f3-3d37-4f19-bb00-13d2908b8dd6 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d for instance with vm_state building and task_state spawning.
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-4d70ba56-ff3a-43a2-ba33-0d42492a18a1 req-cb1ac2d6-7faa-4d43-bae0-64c53f929c55 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4d70ba56-ff3a-43a2-ba33-0d42492a18a1 req-cb1ac2d6-7faa-4d43-bae0-64c53f929c55 service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4d70ba56-ff3a-43a2-ba33-0d42492a18a1 req-cb1ac2d6-7faa-4d43-bae0-64c53f929c55 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4d70ba56-ff3a-43a2-ba33-0d42492a18a1 req-cb1ac2d6-7faa-4d43-bae0-64c53f929c55 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-4d70ba56-ff3a-43a2-ba33-0d42492a18a1 req-cb1ac2d6-7faa-4d43-bae0-64c53f929c55 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:41 user nova-compute[73079]: WARNING nova.compute.manager [req-4d70ba56-ff3a-43a2-ba33-0d42492a18a1 req-cb1ac2d6-7faa-4d43-bae0-64c53f929c55 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 for instance with vm_state building and task_state spawning.
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:42 user nova-compute[73079]: WARNING nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 for instance with vm_state building and task_state spawning.
Aug 17 14:54:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:42 user nova-compute[73079]: WARNING nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf for instance with vm_state building and task_state spawning.
Aug 17 14:54:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:42 user nova-compute[73079]: WARNING nova.compute.manager [req-99d8ca76-2ad6-4232-8fa7-7ce7e2357fd6 req-7ab3d928-b25d-470b-8540-20a2d492e984 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf for instance with vm_state building and task_state spawning.
Aug 17 14:54:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-9ca01c05-5693-4800-96a9-6c4fd21d1af4 req-3ab0e851-f922-498c-806a-542dc9c8975c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:43 user nova-compute[73079]: WARNING nova.compute.manager [req-3fbd9896-f346-4efc-8d97-03ad4c9cb4e7 req-b94fe470-d703-4651-ae95-3aed8cca8bda service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 for instance with vm_state building and task_state spawning.
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284085.069221, 3ef3f716-ed73-4478-b367-37ac0377df63 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] VM Resumed (Lifecycle Event)
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance spawned successfully.
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284085.0758393, 3ef3f716-ed73-4478-b367-37ac0377df63 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] VM Started (Lifecycle Event)
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Took 11.08 seconds to spawn the instance on the hypervisor.
Aug 17 14:54:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:45 user nova-compute[73079]: INFO nova.compute.manager [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Took 69.12 seconds to build instance.
Aug 17 14:54:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b41d9d9d-12e1-4c98-917f-9e102147dc49 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "3ef3f716-ed73-4478-b367-37ac0377df63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 69.303s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:48 user nova-compute[73079]: INFO nova.compute.manager [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Unshelving
Aug 17 14:54:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG nova.objects.instance [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'pci_requests' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG nova.objects.instance [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'numa_topology' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:54:48 user nova-compute[73079]: INFO nova.compute.claims [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Claim successful on node user
Aug 17 14:54:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:48 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:54:49 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:54:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:49 user nova-compute[73079]: INFO nova.network.neutron [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating port e242a398-9deb-40de-bf4d-ff67ed34bba9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing instance network info cache due to event network-changed-e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:54:50 user nova-compute[73079]: INFO nova.compute.claims [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Claim successful on node user
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284075.3824813, 1bbf6615-32dd-41eb-a14c-685476f49c5b => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:54:50 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] VM Stopped (Lifecycle Event)
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a36fc936-9507-4843-bea6-2c3408b46639 None None] [instance: 1bbf6615-32dd-41eb-a14c-685476f49c5b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:54:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Creating image(s)
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.objects.instance [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Refreshing network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "0dae4fe03faee2d6180689be5abd59145d8508b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "0dae4fe03faee2d6180689be5abd59145d8508b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:54:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:54:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:54:51 user nova-compute[73079]: INFO nova.virt.block_device [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Booting with volume 11e51176-276b-4225-8eec-e14ba0939172 at /dev/vda
Aug 17 14:54:51 user nova-compute[73079]: DEBUG os_brick.utils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.part --force-share --output=json" returned: 0 in 0.282s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG nova.virt.images [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] 8c61bf1c-5059-4719-ae57-c4ae2b55607d was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.part /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG nova.policy [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '722f38129c96487b8331cde0ab317832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9478b753e2040e799f28e18c5a82223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e75a62-d23a-4120-a028-21eddb86f218]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[df96b547-074f-45cb-8e2f-56a88cde5a30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dbec0b-e566-4cd6-91de-89d88c623c32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2ba6a-d719-45fc-8013-55f47f53c6c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:54:52 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b96ca5-ebbe-4b69-8c65-94030a3bcf28]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG os_brick.utils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating existing volume attachment record: f9538a2a-915e-4c8e-8f3c-944b64d50137 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.part /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.converted" returned: 0 in 0.256s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "0dae4fe03faee2d6180689be5abd59145d8508b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.742s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updated VIF entry in instance network info cache for port e242a398-9deb-40de-bf4d-ff67ed34bba9. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9e03b9cd-1b87-4a5b-894b-80b6d5f646b2 req-0e6623d1-b35e-4d33-9509-be2580497876 service nova] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "0dae4fe03faee2d6180689be5abd59145d8508b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "0dae4fe03faee2d6180689be5abd59145d8508b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1,backing_fmt=raw /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1,backing_fmt=raw /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk 1073741824" returned: 0 in 0.066s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "0dae4fe03faee2d6180689be5abd59145d8508b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Successfully created port: 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'migration_context' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:53 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Rebasing disk image.
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 -F raw /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Successfully updated port: 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquired lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-changed-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Refreshing instance network info cache due to event network-changed-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:54:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] Acquiring lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:54:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:54:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating instance_info_cache with network_info: [{"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Releasing lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:54:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Instance network_info: |[{"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:54:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] Acquired lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:54:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Refreshing network info cache for port 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.network.neutron [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updated VIF entry in instance network info cache for port 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.network.neutron [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating instance_info_cache with network_info: [{"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-51775f4e-edff-4fc0-9076-9a4ef3ef889a req-f487c9f2-7ad2-41a9-89da-81a7de253b82 service nova] Releasing lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 -F raw /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk" returned: 0 in 2.504s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Ensure instance console log exists: /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Start _get_guest_xml network_info=[{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ef35838c88523d7570d0ea06ccc6edbf',container_format='bare',created_at=2023-08-17T14:52:55Z,direct_url=<?>,disk_format='qcow2',id=8c61bf1c-5059-4719-ae57-c4ae2b55607d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-133672793-shelved',owner='eb0da7dcf51b4267a38083a278e58ef9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T14:53:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:54:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ef35838c88523d7570d0ea06ccc6edbf',container_format='bare',created_at=2023-08-17T14:52:55Z,direct_url=<?>,disk_format='qcow2',id=8c61bf1c-5059-4719-ae57-c4ae2b55607d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-133672793-shelved',owner='eb0da7dcf51b4267a38083a278e58ef9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T14:53:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133672793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133672793',id=21,image_ref='8c61bf1c-5059-4719-ae57-c4ae2b55607d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-756591381',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-a1wbitbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member',shelved_at='2023-08-17T14:53:00.539959',shelved_host='user',shelved_image_id='8c61bf1c-5059-4719-ae57-c4ae2b55607d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=d1f17d9d-7ffb-4b15-abdb-39c9b979118c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'pci_devices' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:54:55 user nova-compute[73079]:   <uuid>d1f17d9d-7ffb-4b15-abdb-39c9b979118c</uuid>
Aug 17 14:54:55 user nova-compute[73079]:   <name>instance-00000015</name>
Aug 17 14:54:55 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:54:55 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:54:55 user nova-compute[73079]:   <metadata>
Aug 17 14:54:55 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:54:55 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:54:55 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-133672793</nova:name>
Aug 17 14:54:55 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:54:55</nova:creationTime>
Aug 17 14:54:55 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:54:55 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:54:55 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:54:55 user nova-compute[73079]:       <nova:owner>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:user uuid="bb1feccca7d645ac90dff8f481bfe139">tempest-AttachVolumeShelveTestJSON-474259075-project-member</nova:user>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:project uuid="eb0da7dcf51b4267a38083a278e58ef9">tempest-AttachVolumeShelveTestJSON-474259075</nova:project>
Aug 17 14:54:55 user nova-compute[73079]:       </nova:owner>
Aug 17 14:54:55 user nova-compute[73079]:       <nova:root type="image" uuid="8c61bf1c-5059-4719-ae57-c4ae2b55607d"/>
Aug 17 14:54:55 user nova-compute[73079]:       <nova:ports>
Aug 17 14:54:55 user nova-compute[73079]:         <nova:port uuid="e242a398-9deb-40de-bf4d-ff67ed34bba9">
Aug 17 14:54:55 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 14:54:55 user nova-compute[73079]:         </nova:port>
Aug 17 14:54:55 user nova-compute[73079]:       </nova:ports>
Aug 17 14:54:55 user nova-compute[73079]:     </nova:instance>
Aug 17 14:54:55 user nova-compute[73079]:   </metadata>
Aug 17 14:54:55 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:54:55 user nova-compute[73079]:     <system>
Aug 17 14:54:55 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:54:55 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:54:55 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:54:55 user nova-compute[73079]:       <entry name="serial">d1f17d9d-7ffb-4b15-abdb-39c9b979118c</entry>
Aug 17 14:54:55 user nova-compute[73079]:       <entry name="uuid">d1f17d9d-7ffb-4b15-abdb-39c9b979118c</entry>
Aug 17 14:54:55 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:54:55 user nova-compute[73079]:     </system>
Aug 17 14:54:55 user nova-compute[73079]:   </sysinfo>
Aug 17 14:54:55 user nova-compute[73079]:   <os>
Aug 17 14:54:55 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:54:55 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:54:55 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:54:55 user nova-compute[73079]:   </os>
Aug 17 14:54:55 user nova-compute[73079]:   <features>
Aug 17 14:54:55 user nova-compute[73079]:     <acpi/>
Aug 17 14:54:55 user nova-compute[73079]:     <apic/>
Aug 17 14:54:55 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:54:55 user nova-compute[73079]:   </features>
Aug 17 14:54:55 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:54:55 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:54:55 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:54:55 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:54:55 user nova-compute[73079]:   </clock>
Aug 17 14:54:55 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:54:55 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:54:55 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:54:55 user nova-compute[73079]:   </cpu>
Aug 17 14:54:55 user nova-compute[73079]:   <devices>
Aug 17 14:54:55 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:54:55 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:54:55 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk"/>
Aug 17 14:54:55 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:54:55 user nova-compute[73079]:     </disk>
Aug 17 14:54:55 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:54:55 user nova-compute[73079]:       <mac address="fa:16:3e:be:9e:75"/>
Aug 17 14:54:55 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:55 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:54:55 user nova-compute[73079]:       <target dev="tape242a398-9d"/>
Aug 17 14:54:55 user nova-compute[73079]:     </interface>
Aug 17 14:54:55 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:54:55 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/console.log" append="off"/>
Aug 17 14:54:55 user nova-compute[73079]:     </serial>
Aug 17 14:54:55 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:54:55 user nova-compute[73079]:     <video>
Aug 17 14:54:55 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:54:55 user nova-compute[73079]:     </video>
Aug 17 14:54:55 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:54:55 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:54:55 user nova-compute[73079]:     </rng>
Aug 17 14:54:55 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:54:55 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:54:55 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:54:55 user nova-compute[73079]:     </memballoon>
Aug 17 14:54:55 user nova-compute[73079]:   </devices>
Aug 17 14:54:55 user nova-compute[73079]: </domain>
Aug 17 14:54:55 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133672793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133672793',id=21,image_ref='8c61bf1c-5059-4719-ae57-c4ae2b55607d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-756591381',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-a1wbitbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member',shelved_at='2023-08-17T14:53:00.539959',shelved_host='user',shelved_image_id='8c61bf1c-5059-4719-ae57-c4ae2b55607d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=d1f17d9d-7ffb-4b15-abdb-39c9b979118c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG os_vif [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape242a398-9d, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape242a398-9d, col_values=(('external_ids', {'iface-id': 'e242a398-9deb-40de-bf4d-ff67ed34bba9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:9e:75', 'vm-uuid': 'd1f17d9d-7ffb-4b15-abdb-39c9b979118c'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:54:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:55 user nova-compute[73079]: INFO os_vif [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d')
Aug 17 14:54:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:54:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] No VIF found with MAC fa:16:3e:be:9e:75, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:54:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f287350a-c3fd-4c02-a9fe-7c54c36f3247 req-1d4d56cc-1c81-4120-a6d8-3ee8f2c4d0ff service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f287350a-c3fd-4c02-a9fe-7c54c36f3247 req-1d4d56cc-1c81-4120-a6d8-3ee8f2c4d0ff service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f287350a-c3fd-4c02-a9fe-7c54c36f3247 req-1d4d56cc-1c81-4120-a6d8-3ee8f2c4d0ff service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f287350a-c3fd-4c02-a9fe-7c54c36f3247 req-1d4d56cc-1c81-4120-a6d8-3ee8f2c4d0ff service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-f287350a-c3fd-4c02-a9fe-7c54c36f3247 req-1d4d56cc-1c81-4120-a6d8-3ee8f2c4d0ff service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:54:58 user nova-compute[73079]: WARNING nova.compute.manager [req-f287350a-c3fd-4c02-a9fe-7c54c36f3247 req-1d4d56cc-1c81-4120-a6d8-3ee8f2c4d0ff service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 14:54:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:54:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-e20c13da-af42-4510-a913-72b14a2079ee req-13be5231-75c3-4c9c-8255-8258a78511c7 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e20c13da-af42-4510-a913-72b14a2079ee req-13be5231-75c3-4c9c-8255-8258a78511c7 service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e20c13da-af42-4510-a913-72b14a2079ee req-13be5231-75c3-4c9c-8255-8258a78511c7 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e20c13da-af42-4510-a913-72b14a2079ee req-13be5231-75c3-4c9c-8255-8258a78511c7 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-e20c13da-af42-4510-a913-72b14a2079ee req-13be5231-75c3-4c9c-8255-8258a78511c7 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:00 user nova-compute[73079]: WARNING nova.compute.manager [req-e20c13da-af42-4510-a913-72b14a2079ee req-13be5231-75c3-4c9c-8255-8258a78511c7 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284100.4111116, d1f17d9d-7ffb-4b15-abdb-39c9b979118c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] VM Resumed (Lifecycle Event)
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:55:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance spawned successfully.
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284100.4150884, d1f17d9d-7ffb-4b15-abdb-39c9b979118c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] VM Started (Lifecycle Event)
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:00 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:55:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-655f30a9-656f-4b7f-8d84-3336e62c7be5 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.181s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:55:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Creating image(s)
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Ensure instance console log exists: /opt/stack/data/nova/instances/1115c466-99e9-408e-87c4-4fa6505d3eb3/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Start _get_guest_xml network_info=[{"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'f9538a2a-915e-4c8e-8f3c-944b64d50137', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySwAeLXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1115c466-99e9-408e-87c4-4fa6505d3eb3', 'attached_at': '', 'detached_at': '', 'volume_id': '11e51176-276b-4225-8eec-e14ba0939172', 'serial': '11e51176-276b-4225-8eec-e14ba0939172'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:55:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySwAeLXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:55:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:04 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed7a0d-a90b-4fa9-80c2-c7b5e8fee552]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:55:04 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8a00e-e10a-4f62-805d-6de469da2443]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172] added
Aug 17 14:55:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b4cd8b-b203-440f-8ab0-a0186cdd81e0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[176056e3-e23f-425d-994f-15883558f2de]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySwAeLXi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySwAeLXi" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e16754-2c67-465e-a077-e9c6a95ffa0c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySwAeLXi'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e28f6-ba74-4de7-bd00-8165e59407b4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a829a-24b8-4045-8b60-c639437f5167]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3500e8-2031-4320-be83-ad38e6c976fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260]
Aug 17 14:55:05 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260] successful.
Aug 17 14:55:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79361d-2a23-48df-8138-112fd383e0da]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[47605fd1-532c-4fd1-92a8-cd2975b0c8a3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afece5e-f321-493b-b180-3d819b8b7b68]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySwAeLXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:55:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26533383863353862', 'path': '/dev/sdf'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533383863353862', 'path': '/dev/sdf'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1881575607',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1881575607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1881575607',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIlIEkPOe6KNCvBnzb+i8c/HUsoVzKJ3cmt24qtRU34xBBVyb1jrN4b9Qol1GZzR9REHW0g/Zur7bbc26+phvIc3qJqWOHTw/LXF31Sj3szV8PUPCuG5HQocp/sp3nZvg==',key_name='tempest-keypair-1853360758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-giccfphp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='722f38129c96487b8331cde0ab317832',uuid=1115c466-99e9-408e-87c4-4fa6505d3eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.objects.instance [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'pci_devices' on Instance uuid 1115c466-99e9-408e-87c4-4fa6505d3eb3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:55:06 user nova-compute[73079]:   <uuid>1115c466-99e9-408e-87c4-4fa6505d3eb3</uuid>
Aug 17 14:55:06 user nova-compute[73079]:   <name>instance-0000001c</name>
Aug 17 14:55:06 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:55:06 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:55:06 user nova-compute[73079]:   <metadata>
Aug 17 14:55:06 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:55:06 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:55:06 user nova-compute[73079]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1881575607</nova:name>
Aug 17 14:55:06 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:55:04</nova:creationTime>
Aug 17 14:55:06 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:55:06 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:55:06 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:55:06 user nova-compute[73079]:       <nova:owner>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:user uuid="722f38129c96487b8331cde0ab317832">tempest-TestVolumeBootPattern-1112851866-project-member</nova:user>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:project uuid="c9478b753e2040e799f28e18c5a82223">tempest-TestVolumeBootPattern-1112851866</nova:project>
Aug 17 14:55:06 user nova-compute[73079]:       </nova:owner>
Aug 17 14:55:06 user nova-compute[73079]:       <nova:ports>
Aug 17 14:55:06 user nova-compute[73079]:         <nova:port uuid="2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc">
Aug 17 14:55:06 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 14:55:06 user nova-compute[73079]:         </nova:port>
Aug 17 14:55:06 user nova-compute[73079]:       </nova:ports>
Aug 17 14:55:06 user nova-compute[73079]:     </nova:instance>
Aug 17 14:55:06 user nova-compute[73079]:   </metadata>
Aug 17 14:55:06 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:55:06 user nova-compute[73079]:     <system>
Aug 17 14:55:06 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:55:06 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:55:06 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:55:06 user nova-compute[73079]:       <entry name="serial">1115c466-99e9-408e-87c4-4fa6505d3eb3</entry>
Aug 17 14:55:06 user nova-compute[73079]:       <entry name="uuid">1115c466-99e9-408e-87c4-4fa6505d3eb3</entry>
Aug 17 14:55:06 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:55:06 user nova-compute[73079]:     </system>
Aug 17 14:55:06 user nova-compute[73079]:   </sysinfo>
Aug 17 14:55:06 user nova-compute[73079]:   <os>
Aug 17 14:55:06 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:55:06 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:55:06 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:55:06 user nova-compute[73079]:   </os>
Aug 17 14:55:06 user nova-compute[73079]:   <features>
Aug 17 14:55:06 user nova-compute[73079]:     <acpi/>
Aug 17 14:55:06 user nova-compute[73079]:     <apic/>
Aug 17 14:55:06 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:55:06 user nova-compute[73079]:   </features>
Aug 17 14:55:06 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:55:06 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:55:06 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:55:06 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:55:06 user nova-compute[73079]:   </clock>
Aug 17 14:55:06 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:55:06 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:55:06 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:55:06 user nova-compute[73079]:   </cpu>
Aug 17 14:55:06 user nova-compute[73079]:   <devices>
Aug 17 14:55:06 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:55:06 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:55:06 user nova-compute[73079]:       <source dev="/dev/sdf"/>
Aug 17 14:55:06 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:55:06 user nova-compute[73079]:       <serial>11e51176-276b-4225-8eec-e14ba0939172</serial>
Aug 17 14:55:06 user nova-compute[73079]:     </disk>
Aug 17 14:55:06 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:55:06 user nova-compute[73079]:       <mac address="fa:16:3e:d1:73:0b"/>
Aug 17 14:55:06 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:55:06 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:55:06 user nova-compute[73079]:       <target dev="tap2a1697f4-98"/>
Aug 17 14:55:06 user nova-compute[73079]:     </interface>
Aug 17 14:55:06 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:55:06 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/1115c466-99e9-408e-87c4-4fa6505d3eb3/console.log" append="off"/>
Aug 17 14:55:06 user nova-compute[73079]:     </serial>
Aug 17 14:55:06 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:55:06 user nova-compute[73079]:     <video>
Aug 17 14:55:06 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:55:06 user nova-compute[73079]:     </video>
Aug 17 14:55:06 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:55:06 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:55:06 user nova-compute[73079]:     </rng>
Aug 17 14:55:06 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:55:06 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:55:06 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:55:06 user nova-compute[73079]:     </memballoon>
Aug 17 14:55:06 user nova-compute[73079]:   </devices>
Aug 17 14:55:06 user nova-compute[73079]: </domain>
Aug 17 14:55:06 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1881575607',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1881575607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1881575607',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIlIEkPOe6KNCvBnzb+i8c/HUsoVzKJ3cmt24qtRU34xBBVyb1jrN4b9Qol1GZzR9REHW0g/Zur7bbc26+phvIc3qJqWOHTw/LXF31Sj3szV8PUPCuG5HQocp/sp3nZvg==',key_name='tempest-keypair-1853360758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-giccfphp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='722f38129c96487b8331cde0ab317832',uuid=1115c466-99e9-408e-87c4-4fa6505d3eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG os_vif [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a1697f4-98, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a1697f4-98, col_values=(('external_ids', {'iface-id': '2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:73:0b', 'vm-uuid': '1115c466-99e9-408e-87c4-4fa6505d3eb3'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:06 user nova-compute[73079]: INFO os_vif [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98')
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No VIF found with MAC fa:16:3e:d1:73:0b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:55:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-changed-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Refreshing instance network info cache due to event network-changed-6d05a5a0-ca5c-4036-ae62-30d073baa3e3. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] Acquiring lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] Acquired lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG nova.network.neutron [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Refreshing network info cache for port 6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG nova.network.neutron [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updated VIF entry in instance network info cache for port 6d05a5a0-ca5c-4036-ae62-30d073baa3e3. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG nova.network.neutron [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updating instance_info_cache with network_info: [{"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-69851710-9b62-4045-8014-6a21e8b1e5d5 req-884d90eb-0395-4c5a-a0ae-e440c0f13496 service nova] Releasing lock "refresh_cache-f25d4a41-0990-48b1-a2a9-fd3849526044" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-cd5a7149-c7a3-42d6-92d4-e15f7ddba87f req-25db9b4e-2652-491e-883c-3e7bf2e5f931 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cd5a7149-c7a3-42d6-92d4-e15f7ddba87f req-25db9b4e-2652-491e-883c-3e7bf2e5f931 service nova] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cd5a7149-c7a3-42d6-92d4-e15f7ddba87f req-25db9b4e-2652-491e-883c-3e7bf2e5f931 service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-cd5a7149-c7a3-42d6-92d4-e15f7ddba87f req-25db9b4e-2652-491e-883c-3e7bf2e5f931 service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-cd5a7149-c7a3-42d6-92d4-e15f7ddba87f req-25db9b4e-2652-491e-883c-3e7bf2e5f931 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] No waiting events found dispatching network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:08 user nova-compute[73079]: WARNING nova.compute.manager [req-cd5a7149-c7a3-42d6-92d4-e15f7ddba87f req-25db9b4e-2652-491e-883c-3e7bf2e5f931 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received unexpected event network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc for instance with vm_state building and task_state spawning.
Aug 17 14:55:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284110.1401258, 1115c466-99e9-408e-87c4-4fa6505d3eb3 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] VM Resumed (Lifecycle Event)
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Instance spawned successfully.
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284110.1404903, 1115c466-99e9-408e-87c4-4fa6505d3eb3 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] VM Started (Lifecycle Event)
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:10 user nova-compute[73079]: INFO nova.compute.manager [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Took 20.16 seconds to build instance.
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-7eea7bd9-9075-4a52-a662-72953aae673b req-d3f684df-ada6-40d4-9b89-ac81b6cdc3c9 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7eea7bd9-9075-4a52-a662-72953aae673b req-d3f684df-ada6-40d4-9b89-ac81b6cdc3c9 service nova] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7eea7bd9-9075-4a52-a662-72953aae673b req-d3f684df-ada6-40d4-9b89-ac81b6cdc3c9 service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7eea7bd9-9075-4a52-a662-72953aae673b req-d3f684df-ada6-40d4-9b89-ac81b6cdc3c9 service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-7eea7bd9-9075-4a52-a662-72953aae673b req-d3f684df-ada6-40d4-9b89-ac81b6cdc3c9 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] No waiting events found dispatching network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:10 user nova-compute[73079]: WARNING nova.compute.manager [req-7eea7bd9-9075-4a52-a662-72953aae673b req-d3f684df-ada6-40d4-9b89-ac81b6cdc3c9 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received unexpected event network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc for instance with vm_state building and task_state spawning.
Aug 17 14:55:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-23b4234f-bae6-4906-b8f4-588d3ec84a74 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.276s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:55:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:15 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:15 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=25.47823715209961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance f25d4a41-0990-48b1-a2a9-fd3849526044 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3ef3f716-ed73-4478-b367-37ac0377df63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance d1f17d9d-7ffb-4b15-abdb-39c9b979118c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1115c466-99e9-408e-87c4-4fa6505d3eb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:55:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:55:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:55:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:55:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:55:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:55:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lazy-loading 'flavor' on Instance uuid f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:25 user nova-compute[73079]: INFO nova.compute.manager [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Attaching volume 6f7c64c2-c685-47e2-83d1-a776760599cd to /dev/vdb
Aug 17 14:55:25 user nova-compute[73079]: DEBUG os_brick.utils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f8e6fa-c560-4fc3-b7f5-0c743ab8ff63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb2e08-10a2-4642-b362-5738c9347dd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8e3cb8-952d-4eae-9e03-b97a5c793dfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c3af0e-5079-481e-bd55-208d58a2f093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:55:25 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:55:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64110c-5ddf-4e23-81b5-8c0122928438]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG os_brick.utils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:55:25 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updating existing volume attachment record: 250d8605-9564-4abc-bd1a-79c672f75a70 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:55:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:55:29 user nova-compute[73079]: INFO nova.compute.claims [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Claim successful on node user
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:55:29 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.policy [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7edb85ca3cd14d4587b951327e892bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac38bd75ed4e588b516582286bfb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:55:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:55:29 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Creating image(s)
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "/opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk 1073741824" returned: 0 in 0.080s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Successfully created port: 8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Cannot resize image /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG nova.objects.instance [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'migration_context' on Instance uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Ensure instance console log exists: /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Successfully updated port: 8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquired lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-changed-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Refreshing instance network info cache due to event network-changed-8fe47894-51f1-4803-8dd1-ad9f481df301. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] Acquiring lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:55:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updating instance_info_cache with network_info: [{"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Releasing lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Instance network_info: |[{"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] Acquired lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Refreshing network info cache for port 8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Start _get_guest_xml network_info=[{"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:55:32 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:32 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1774340719',display_name='tempest-AttachVolumeNegativeTest-server-1774340719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1774340719',id=29,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/w3zmNcNwqoSDPAkRYR5I9Yyux3yr7yxs91etvcnpIKFW+fSr3/f5M0MXtALRqvXLyWTZyYeeakyfz7GVKCdpwuyS5yqenk8S2P6/aTbazDdmUOp8MhInztaWYOrI0ow==',key_name='tempest-keypair-163331995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-jfh11y9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=874920b0-5183-4377-b2f7-46c9a65395c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'pci_devices' on Instance uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:55:32 user nova-compute[73079]:   <uuid>874920b0-5183-4377-b2f7-46c9a65395c4</uuid>
Aug 17 14:55:32 user nova-compute[73079]:   <name>instance-0000001d</name>
Aug 17 14:55:32 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:55:32 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:55:32 user nova-compute[73079]:   <metadata>
Aug 17 14:55:32 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:55:32 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:55:32 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1774340719</nova:name>
Aug 17 14:55:32 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:55:32</nova:creationTime>
Aug 17 14:55:32 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:55:32 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:55:32 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:55:32 user nova-compute[73079]:       <nova:owner>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:user uuid="7edb85ca3cd14d4587b951327e892bd6">tempest-AttachVolumeNegativeTest-706656920-project-member</nova:user>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:project uuid="04ac38bd75ed4e588b516582286bfb97">tempest-AttachVolumeNegativeTest-706656920</nova:project>
Aug 17 14:55:32 user nova-compute[73079]:       </nova:owner>
Aug 17 14:55:32 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:55:32 user nova-compute[73079]:       <nova:ports>
Aug 17 14:55:32 user nova-compute[73079]:         <nova:port uuid="8fe47894-51f1-4803-8dd1-ad9f481df301">
Aug 17 14:55:32 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 14:55:32 user nova-compute[73079]:         </nova:port>
Aug 17 14:55:32 user nova-compute[73079]:       </nova:ports>
Aug 17 14:55:32 user nova-compute[73079]:     </nova:instance>
Aug 17 14:55:32 user nova-compute[73079]:   </metadata>
Aug 17 14:55:32 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:55:32 user nova-compute[73079]:     <system>
Aug 17 14:55:32 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:55:32 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:55:32 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:55:32 user nova-compute[73079]:       <entry name="serial">874920b0-5183-4377-b2f7-46c9a65395c4</entry>
Aug 17 14:55:32 user nova-compute[73079]:       <entry name="uuid">874920b0-5183-4377-b2f7-46c9a65395c4</entry>
Aug 17 14:55:32 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:55:32 user nova-compute[73079]:     </system>
Aug 17 14:55:32 user nova-compute[73079]:   </sysinfo>
Aug 17 14:55:32 user nova-compute[73079]:   <os>
Aug 17 14:55:32 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:55:32 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:55:32 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:55:32 user nova-compute[73079]:   </os>
Aug 17 14:55:32 user nova-compute[73079]:   <features>
Aug 17 14:55:32 user nova-compute[73079]:     <acpi/>
Aug 17 14:55:32 user nova-compute[73079]:     <apic/>
Aug 17 14:55:32 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:55:32 user nova-compute[73079]:   </features>
Aug 17 14:55:32 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:55:32 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:55:32 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:55:32 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:55:32 user nova-compute[73079]:   </clock>
Aug 17 14:55:32 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:55:32 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:55:32 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:55:32 user nova-compute[73079]:   </cpu>
Aug 17 14:55:32 user nova-compute[73079]:   <devices>
Aug 17 14:55:32 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:55:32 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:55:32 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk"/>
Aug 17 14:55:32 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:55:32 user nova-compute[73079]:     </disk>
Aug 17 14:55:32 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:55:32 user nova-compute[73079]:       <mac address="fa:16:3e:9a:4f:8e"/>
Aug 17 14:55:32 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:55:32 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:55:32 user nova-compute[73079]:       <target dev="tap8fe47894-51"/>
Aug 17 14:55:32 user nova-compute[73079]:     </interface>
Aug 17 14:55:32 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:55:32 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/console.log" append="off"/>
Aug 17 14:55:32 user nova-compute[73079]:     </serial>
Aug 17 14:55:32 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:55:32 user nova-compute[73079]:     <video>
Aug 17 14:55:32 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:55:32 user nova-compute[73079]:     </video>
Aug 17 14:55:32 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:55:32 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:55:32 user nova-compute[73079]:     </rng>
Aug 17 14:55:32 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:55:32 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:55:32 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:55:32 user nova-compute[73079]:     </memballoon>
Aug 17 14:55:32 user nova-compute[73079]:   </devices>
Aug 17 14:55:32 user nova-compute[73079]: </domain>
Aug 17 14:55:32 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1774340719',display_name='tempest-AttachVolumeNegativeTest-server-1774340719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1774340719',id=29,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/w3zmNcNwqoSDPAkRYR5I9Yyux3yr7yxs91etvcnpIKFW+fSr3/f5M0MXtALRqvXLyWTZyYeeakyfz7GVKCdpwuyS5yqenk8S2P6/aTbazDdmUOp8MhInztaWYOrI0ow==',key_name='tempest-keypair-163331995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-jfh11y9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=874920b0-5183-4377-b2f7-46c9a65395c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG os_vif [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe47894-51, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fe47894-51, col_values=(('external_ids', {'iface-id': '8fe47894-51f1-4803-8dd1-ad9f481df301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:4f:8e', 'vm-uuid': '874920b0-5183-4377-b2f7-46c9a65395c4'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:32 user nova-compute[73079]: INFO os_vif [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51')
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:9a:4f:8e, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updated VIF entry in instance network info cache for port 8fe47894-51f1-4803-8dd1-ad9f481df301. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updating instance_info_cache with network_info: [{"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:55:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-08fae33b-d333-49d0-928e-6f85b112d0cf req-9f6649f6-18c0-40ab-8f12-7f0837a3ef5e service nova] Releasing lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-e09a7761-a027-41b6-bf66-3318bd1e0a1d req-deefeb85-a3eb-4129-9a1e-74fbf76c5390 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e09a7761-a027-41b6-bf66-3318bd1e0a1d req-deefeb85-a3eb-4129-9a1e-74fbf76c5390 service nova] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e09a7761-a027-41b6-bf66-3318bd1e0a1d req-deefeb85-a3eb-4129-9a1e-74fbf76c5390 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e09a7761-a027-41b6-bf66-3318bd1e0a1d req-deefeb85-a3eb-4129-9a1e-74fbf76c5390 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-e09a7761-a027-41b6-bf66-3318bd1e0a1d req-deefeb85-a3eb-4129-9a1e-74fbf76c5390 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] No waiting events found dispatching network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:33 user nova-compute[73079]: WARNING nova.compute.manager [req-e09a7761-a027-41b6-bf66-3318bd1e0a1d req-deefeb85-a3eb-4129-9a1e-74fbf76c5390 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received unexpected event network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 for instance with vm_state building and task_state spawning.
Aug 17 14:55:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-7e9737de-7ccc-4ffc-982c-bbcbf2296947 req-443f3a50-1db5-4703-babf-2a216ce81177 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7e9737de-7ccc-4ffc-982c-bbcbf2296947 req-443f3a50-1db5-4703-babf-2a216ce81177 service nova] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7e9737de-7ccc-4ffc-982c-bbcbf2296947 req-443f3a50-1db5-4703-babf-2a216ce81177 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7e9737de-7ccc-4ffc-982c-bbcbf2296947 req-443f3a50-1db5-4703-babf-2a216ce81177 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-7e9737de-7ccc-4ffc-982c-bbcbf2296947 req-443f3a50-1db5-4703-babf-2a216ce81177 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] No waiting events found dispatching network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:35 user nova-compute[73079]: WARNING nova.compute.manager [req-7e9737de-7ccc-4ffc-982c-bbcbf2296947 req-443f3a50-1db5-4703-babf-2a216ce81177 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received unexpected event network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 for instance with vm_state building and task_state spawning.
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284135.9110177, 874920b0-5183-4377-b2f7-46c9a65395c4 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:35 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] VM Resumed (Lifecycle Event)
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:55:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Instance spawned successfully.
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:55:35 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:55:35 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284135.9127307, 874920b0-5183-4377-b2f7-46c9a65395c4 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:35 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] VM Started (Lifecycle Event)
Aug 17 14:55:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:36 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:55:36 user nova-compute[73079]: INFO nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 17 14:55:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:36 user nova-compute[73079]: INFO nova.compute.manager [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Took 6.83 seconds to build instance.
Aug 17 14:55:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-be8dddee-ab17-47f4-84db-c0a608958e19 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.971s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:36 user nova-compute[73079]: INFO nova.compute.manager [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Rescuing
Aug 17 14:55:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:55:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:55:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:55:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-02d01a81-c9a6-497b-853c-5b6ba08f9211 req-285a83cf-90c0-48d9-9ce1-ade0a3dc25cc service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-02d01a81-c9a6-497b-853c-5b6ba08f9211 req-285a83cf-90c0-48d9-9ce1-ade0a3dc25cc service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-02d01a81-c9a6-497b-853c-5b6ba08f9211 req-285a83cf-90c0-48d9-9ce1-ade0a3dc25cc service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-02d01a81-c9a6-497b-853c-5b6ba08f9211 req-285a83cf-90c0-48d9-9ce1-ade0a3dc25cc service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-02d01a81-c9a6-497b-853c-5b6ba08f9211 req-285a83cf-90c0-48d9-9ce1-ade0a3dc25cc service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:37 user nova-compute[73079]: WARNING nova.compute.manager [req-02d01a81-c9a6-497b-853c-5b6ba08f9211 req-285a83cf-90c0-48d9-9ce1-ade0a3dc25cc service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state active and task_state rescuing.
Aug 17 14:55:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance destroyed successfully.
Aug 17 14:55:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Attempting a stable device rescue
Aug 17 14:55:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73079) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 14:55:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Creating image(s)
Aug 17 14:55:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "/opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'trusted_certs' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "be1d8c346a00b8e54f88058e59a3b98fc5e5be32" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "be1d8c346a00b8e54f88058e59a3b98fc5e5be32" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxrmZDXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:55:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:38 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fa2e06-720d-4d77-b49a-0e0e65ef6330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:55:39 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ebd7ed-ab3f-4874-b609-bcb174439432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd] added
Aug 17 14:55:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4670fa2-864e-4143-a2c1-590d5db17d6b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f3f829-84c0-401b-b18d-7438c6041181]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxrmZDXz {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CxrmZDXz" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc9659-85da-4386-8733-f9e269a8d410]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CxrmZDXz'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8c09b-a6a7-4edc-bb15-353b76668ad2]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.part --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG nova.virt.images [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] f2961a97-ccc3-46c2-ae02-6a36dd78c066 was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.part /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df70fb-573e-4936-b2cb-d1c86a98209a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-350b734a-8eb5-4282-b02a-89f418e14b5d req-7c1f6d0e-7a3f-4311-9307-a94da2d0642d service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-350b734a-8eb5-4282-b02a-89f418e14b5d req-7c1f6d0e-7a3f-4311-9307-a94da2d0642d service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-350b734a-8eb5-4282-b02a-89f418e14b5d req-7c1f6d0e-7a3f-4311-9307-a94da2d0642d service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-350b734a-8eb5-4282-b02a-89f418e14b5d req-7c1f6d0e-7a3f-4311-9307-a94da2d0642d service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-350b734a-8eb5-4282-b02a-89f418e14b5d req-7c1f6d0e-7a3f-4311-9307-a94da2d0642d service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:39 user nova-compute[73079]: WARNING nova.compute.manager [req-350b734a-8eb5-4282-b02a-89f418e14b5d req-7c1f6d0e-7a3f-4311-9307-a94da2d0642d service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state active and task_state rescuing.
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebc07e-5e7c-454a-a597-0206e05f271d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260]
Aug 17 14:55:39 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260] successful.
Aug 17 14:55:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cd760d-1a24-4b03-9c53-d646a80f1c5d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6aa30e-b085-4491-8ffc-28cd4142a4ed]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)
Aug 17 14:55:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:39 user nova-compute[73079]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)
Aug 17 14:55:39 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.495s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:55:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.115s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cc58de-5a3d-4665-a20d-f3e7ed640bf0]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxrmZDXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.part /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.converted" returned: 0 in 0.566s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "be1d8c346a00b8e54f88058e59a3b98fc5e5be32" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.269s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "be1d8c346a00b8e54f88058e59a3b98fc5e5be32" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "be1d8c346a00b8e54f88058e59a3b98fc5e5be32" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32 --force-share --output=json" returned: 0 in 0.210s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32,backing_fmt=raw /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32,backing_fmt=raw /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "be1d8c346a00b8e54f88058e59a3b98fc5e5be32" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'migration_context' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Start _get_guest_xml network_info=[{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "vif_mac": "fa:16:3e:0d:99:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f2961a97-ccc3-46c2-ae02-6a36dd78c066', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '5a84e20f-d465-4d70-b632-9fc57e12bc56', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '168eb979-11c1-4643-a2e2-b160cbc5f150', 'attached_at': '', 'detached_at': '', 'volume_id': '353cf1f3-e72b-47e3-8f9a-784d15af77e0', 'serial': '353cf1f3-e72b-47e3-8f9a-784d15af77e0'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'resources' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'numa_topology' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:40 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:40 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'vcpu_model' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:55:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:55:40 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.633s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] <== connect_volume: return (2634ms) {'type': 'block', 'scsi_wwn': '26166383138306132', 'path': '/dev/sdg'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166383138306132', 'path': '/dev/sdg'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.198s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:41 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lazy-loading 'flavor' on Instance uuid f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5037edb-bba4-40cf-ad4f-f033ca71308f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gYJnThqC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 14:55:41 user nova-compute[73079]: node.name = iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0
Aug 17 14:55:41 user nova-compute[73079]: node.tpgt = -1
Aug 17 14:55:41 user nova-compute[73079]: node.startup = automatic
Aug 17 14:55:41 user nova-compute[73079]: node.leading_login = No
Aug 17 14:55:41 user nova-compute[73079]: iface.iscsi_ifacename = default
Aug 17 14:55:41 user nova-compute[73079]: iface.net_ifacename = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.ipaddress = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.prefix_len = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.hwaddress = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.transport_name = tcp
Aug 17 14:55:41 user nova-compute[73079]: iface.initiatorname = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.vlan_id = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.vlan_priority = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.vlan_state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.iface_num = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.mtu = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.port = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.bootproto = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.subnet_mask = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.gateway = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_alt_client_id = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_dns = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_learn_iqn = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_vendor_id_state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_vendor_id = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.dhcp_slp_da = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.fragmentation = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.gratuitous_arp = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.incoming_forwarding = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.tos_state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.tos = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.ttl = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.delayed_ack = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.tcp_nagle = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.tcp_wsf_state = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.tcp_wsf = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.tcp_timer_scale = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.tcp_timestamp = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.redirect = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.def_task_mgmt_timeout = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.header_digest = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.data_digest = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.immediate_data = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.initial_r2t = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.data_seq_inorder = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.data_pdu_inorder = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.erl = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.max_receive_data_len = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.first_burst_len = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.max_outstanding_r2t = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.max_burst_len = 0
Aug 17 14:55:41 user nova-compute[73079]: iface.chap_auth = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.bidi_chap = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.strict_login_compliance = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.discovery_auth = <empty>
Aug 17 14:55:41 user nova-compute[73079]: iface.discovery_logout = <empty>
Aug 17 14:55:41 user nova-compute[73079]: node.discovery_address = <empty>
Aug 17 14:55:41 user nova-compute[73079]: node.discovery_port = 0
Aug 17 14:55:41 user nova-compute[73079]: node.discovery_type = static
Aug 17 14:55:41 user nova-compute[73079]: node.session.initial_cmdsn = 0
Aug 17 14:55:41 user nova-compute[73079]: node.session.initial_login_retry_max = 8
Aug 17 14:55:41 user nova-compute[73079]: node.session.xmit_thread_priority = -20
Aug 17 14:55:41 user nova-compute[73079]: node.session.cmds_max = 128
Aug 17 14:55:41 user nova-compute[73079]: node.session.queue_depth = 32
Aug 17 14:55:41 user nova-compute[73079]: node.session.nr_sessions = 1
Aug 17 14:55:41 user nova-compute[73079]: node.session.auth.authmethod = CHAP
Aug 17 14:55:41 user nova-compute[73079]: node.session.auth.username = gYJnThqC
Aug 17 14:55:41 user nova-compute[73079]: node.session.auth.password = ***
Aug 17 14:55:41 user nova-compute[73079]: node.session.auth.username_in = <empty>
Aug 17 14:55:41 user nova-compute[73079]: node.session.auth.password_in = <empty>
Aug 17 14:55:41 user nova-compute[73079]: node.session.auth.chap_algs = MD5
Aug 17 14:55:41 user nova-compute[73079]: node.session.timeo.replacement_timeout = 120
Aug 17 14:55:41 user nova-compute[73079]: node.session.err_timeo.abort_timeout = 15
Aug 17 14:55:41 user nova-compute[73079]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 14:55:41 user nova-compute[73079]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 14:55:41 user nova-compute[73079]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.FastAbort = Yes
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.InitialR2T = No
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.ImmediateData = Yes
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.MaxConnections = 1
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 14:55:41 user nova-compute[73079]: node.session.iscsi.ERL = 0
Aug 17 14:55:41 user nova-compute[73079]: node.session.scan = manual
Aug 17 14:55:41 user nova-compute[73079]: node.session.reopen_max = 0
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].address = 172.16.0.220
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].port = 3260
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].startup = manual
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].tcp.window_size = 524288
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].tcp.type_of_service = 0
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].timeo.logout_timeout = 15
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].timeo.login_timeout = 15
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].timeo.auth_timeout = 45
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].iscsi.DataDigest = None
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].iscsi.IFMarker = No
Aug 17 14:55:41 user nova-compute[73079]: node.conn[0].iscsi.OFMarker = No
Aug 17 14:55:41 user nova-compute[73079]: # END RECORD
Aug 17 14:55:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:55:41 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:55:41 user nova-compute[73079]:   <source dev="/dev/sdg"/>
Aug 17 14:55:41 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:55:41 user nova-compute[73079]:   <serial>6f7c64c2-c685-47e2-83d1-a776760599cd</serial>
Aug 17 14:55:41 user nova-compute[73079]: </disk>
Aug 17 14:55:41 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[52783965-8e4a-46af-88f3-47effd12a2dd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8cda22-4d4c-409f-b7bf-6b91199befc7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYJnThqC {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYJnThqC" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6e0bf-d9ff-4e2e-b513-39acaa3cebae]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gYJnThqC'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a710350-aa59-49cc-9cdc-16de79315998]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[045fee09-5ec4-458a-a541-b21acdf356b6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)
Aug 17 14:55:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:41 user nova-compute[73079]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)
Aug 17 14:55:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9cdc1-7ebc-4b53-9d12-414a89d7f6e7]: (4, ('0 0 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== connect_volume: return (384ms) {'type': 'block', 'scsi_wwn': '26339633165336664', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339633165336664', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720781670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720781670',id=26,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-cuol53ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:54:25Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=168eb979-11c1-4643-a2e2-b160cbc5f150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "vif_mac": "fa:16:3e:0d:99:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "vif_mac": "fa:16:3e:0d:99:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'pci_devices' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:55:41 user nova-compute[73079]:   <uuid>168eb979-11c1-4643-a2e2-b160cbc5f150</uuid>
Aug 17 14:55:41 user nova-compute[73079]:   <name>instance-0000001a</name>
Aug 17 14:55:41 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:55:41 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:55:41 user nova-compute[73079]:   <metadata>
Aug 17 14:55:41 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:55:41 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:55:41 user nova-compute[73079]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1720781670</nova:name>
Aug 17 14:55:41 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:55:40</nova:creationTime>
Aug 17 14:55:41 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:55:41 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:55:41 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:55:41 user nova-compute[73079]:       <nova:owner>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:user uuid="5f67004af6654b5d80924a5c502a74f2">tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member</nova:user>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:project uuid="0edd4ad5f2eb4e728a71908d32d353d5">tempest-ServerBootFromVolumeStableRescueTest-2072772980</nova:project>
Aug 17 14:55:41 user nova-compute[73079]:       </nova:owner>
Aug 17 14:55:41 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:55:41 user nova-compute[73079]:       <nova:ports>
Aug 17 14:55:41 user nova-compute[73079]:         <nova:port uuid="6f8bcd51-97dc-4aef-980d-c3288e4f78ac">
Aug 17 14:55:41 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 14:55:41 user nova-compute[73079]:         </nova:port>
Aug 17 14:55:41 user nova-compute[73079]:       </nova:ports>
Aug 17 14:55:41 user nova-compute[73079]:     </nova:instance>
Aug 17 14:55:41 user nova-compute[73079]:   </metadata>
Aug 17 14:55:41 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:55:41 user nova-compute[73079]:     <system>
Aug 17 14:55:41 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:55:41 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:55:41 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:55:41 user nova-compute[73079]:       <entry name="serial">168eb979-11c1-4643-a2e2-b160cbc5f150</entry>
Aug 17 14:55:41 user nova-compute[73079]:       <entry name="uuid">168eb979-11c1-4643-a2e2-b160cbc5f150</entry>
Aug 17 14:55:41 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:55:41 user nova-compute[73079]:     </system>
Aug 17 14:55:41 user nova-compute[73079]:   </sysinfo>
Aug 17 14:55:41 user nova-compute[73079]:   <os>
Aug 17 14:55:41 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:55:41 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:55:41 user nova-compute[73079]:   </os>
Aug 17 14:55:41 user nova-compute[73079]:   <features>
Aug 17 14:55:41 user nova-compute[73079]:     <acpi/>
Aug 17 14:55:41 user nova-compute[73079]:     <apic/>
Aug 17 14:55:41 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:55:41 user nova-compute[73079]:   </features>
Aug 17 14:55:41 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:55:41 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:55:41 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:55:41 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:55:41 user nova-compute[73079]:   </clock>
Aug 17 14:55:41 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:55:41 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:55:41 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:55:41 user nova-compute[73079]:   </cpu>
Aug 17 14:55:41 user nova-compute[73079]:   <devices>
Aug 17 14:55:41 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:55:41 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:55:41 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 14:55:41 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:55:41 user nova-compute[73079]:       <serial>353cf1f3-e72b-47e3-8f9a-784d15af77e0</serial>
Aug 17 14:55:41 user nova-compute[73079]:     </disk>
Aug 17 14:55:41 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:55:41 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:55:41 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue"/>
Aug 17 14:55:41 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 14:55:41 user nova-compute[73079]:       <boot order="1"/>
Aug 17 14:55:41 user nova-compute[73079]:     </disk>
Aug 17 14:55:41 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:55:41 user nova-compute[73079]:       <mac address="fa:16:3e:0d:99:f0"/>
Aug 17 14:55:41 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:55:41 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:55:41 user nova-compute[73079]:       <target dev="tap6f8bcd51-97"/>
Aug 17 14:55:41 user nova-compute[73079]:     </interface>
Aug 17 14:55:41 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:55:41 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/console.log" append="off"/>
Aug 17 14:55:41 user nova-compute[73079]:     </serial>
Aug 17 14:55:41 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:55:41 user nova-compute[73079]:     <video>
Aug 17 14:55:41 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:55:41 user nova-compute[73079]:     </video>
Aug 17 14:55:41 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:55:41 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:55:41 user nova-compute[73079]:     </rng>
Aug 17 14:55:41 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:55:41 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:55:41 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:55:41 user nova-compute[73079]:     </memballoon>
Aug 17 14:55:41 user nova-compute[73079]:   </devices>
Aug 17 14:55:41 user nova-compute[73079]: </domain>
Aug 17 14:55:41 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:55:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance destroyed successfully.
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No VIF found with MAC fa:16:3e:0d:99:f0, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] No VIF found with MAC fa:16:3e:7a:53:23, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:55:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e2fcb909-83e4-485f-ba51-51a5a1719822 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.388s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-21f5065a-9046-4032-ba90-1cb4cb4ed58a req-c259e03e-616a-4ea4-85ea-a8a7b4fc4c98 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-21f5065a-9046-4032-ba90-1cb4cb4ed58a req-c259e03e-616a-4ea4-85ea-a8a7b4fc4c98 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-21f5065a-9046-4032-ba90-1cb4cb4ed58a req-c259e03e-616a-4ea4-85ea-a8a7b4fc4c98 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-21f5065a-9046-4032-ba90-1cb4cb4ed58a req-c259e03e-616a-4ea4-85ea-a8a7b4fc4c98 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-21f5065a-9046-4032-ba90-1cb4cb4ed58a req-c259e03e-616a-4ea4-85ea-a8a7b4fc4c98 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:43 user nova-compute[73079]: WARNING nova.compute.manager [req-21f5065a-9046-4032-ba90-1cb4cb4ed58a req-c259e03e-616a-4ea4-85ea-a8a7b4fc4c98 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state active and task_state rescuing.
Aug 17 14:55:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:44 user nova-compute[73079]: INFO nova.compute.manager [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Detaching volume 6f7c64c2-c685-47e2-83d1-a776760599cd
Aug 17 14:55:44 user nova-compute[73079]: INFO nova.virt.block_device [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Attempting to driver detach volume 6f7c64c2-c685-47e2-83d1-a776760599cd from mountpoint /dev/vdb
Aug 17 14:55:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Attempting to detach device vdb from instance f25d4a41-0990-48b1-a2a9-fd3849526044 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:55:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:55:44 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:55:44 user nova-compute[73079]:   <source dev="/dev/sdg"/>
Aug 17 14:55:44 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:55:44 user nova-compute[73079]:   <serial>6f7c64c2-c685-47e2-83d1-a776760599cd</serial>
Aug 17 14:55:44 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:55:44 user nova-compute[73079]: </disk>
Aug 17 14:55:44 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:55:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Successfully detached device vdb from instance f25d4a41-0990-48b1-a2a9-fd3849526044 from the persistent domain config.
Aug 17 14:55:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f25d4a41-0990-48b1-a2a9-fd3849526044 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:55:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:55:44 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:55:44 user nova-compute[73079]:   <source dev="/dev/sdg"/>
Aug 17 14:55:44 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:55:44 user nova-compute[73079]:   <serial>6f7c64c2-c685-47e2-83d1-a776760599cd</serial>
Aug 17 14:55:44 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:55:44 user nova-compute[73079]: </disk>
Aug 17 14:55:44 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284145.2928529, f25d4a41-0990-48b1-a2a9-fd3849526044 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:55:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Successfully detached device vdb from instance f25d4a41-0990-48b1-a2a9-fd3849526044 from the live domain config.
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CxrmZDXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:55:45 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[246a0a54-b282-4718-ba6c-72a9ca138de7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 168eb979-11c1-4643-a2e2-b160cbc5f150 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284145.4246807, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Resumed (Lifecycle Event)
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b34d64b-0cac-47c1-8fbd-2aac8d70b2b1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)
Aug 17 14:55:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:55:45 user nova-compute[73079]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd (non-flash)
Aug 17 14:55:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e831d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd'): ({'sdg'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Removing single pathed devices sdg {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-7723dc13-357e-48a4-956a-90311d790d80 req-f3c209ed-5d57-4542-8c60-f99063e6e8d9 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7723dc13-357e-48a4-956a-90311d790d80 req-f3c209ed-5d57-4542-8c60-f99063e6e8d9 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7723dc13-357e-48a4-956a-90311d790d80 req-f3c209ed-5d57-4542-8c60-f99063e6e8d9 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7723dc13-357e-48a4-956a-90311d790d80 req-f3c209ed-5d57-4542-8c60-f99063e6e8d9 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-7723dc13-357e-48a4-956a-90311d790d80 req-f3c209ed-5d57-4542-8c60-f99063e6e8d9 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:55:45 user nova-compute[73079]: WARNING nova.compute.manager [req-7723dc13-357e-48a4-956a-90311d790d80 req-f3c209ed-5d57-4542-8c60-f99063e6e8d9 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state active and task_state rescuing.
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2986cef1-9b9f-4949-b35f-99155b9879ad tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff14d5f7-f0af-4635-8ff3-f5de00c2a721]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0419c4-4a2e-463d-b099-7ebc7b07501b]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Flushing IO for device /dev/sdg {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284145.44138, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:55:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Started (Lifecycle Event)
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0833d634-c8f6-4673-8e6b-25a0fd8a9243]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[499cb735-1e2c-48aa-996e-8f7794505d21]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] SCSI volumes sdg have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5373ae92-442c-42b8-bd36-2b6eebf6f052]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[810bdeb8-2c8d-44dc-b7ab-306a49fa7925]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260]
Aug 17 14:55:45 user nova-compute[73079]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd, portal: 172.16.0.220,3260] successful.
Aug 17 14:55:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f7c64c2-c685-47e2-83d1-a776760599cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51c2c29-c498-4d74-9823-3ebdf438eb41]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] <== disconnect_volume: return (380ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:55:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:55:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-changed-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:55:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Refreshing instance network info cache due to event network-changed-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:55:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] Acquiring lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:55:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] Acquired lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:55:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Refreshing network info cache for port d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:55:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updated VIF entry in instance network info cache for port d65468eb-accc-4f0a-8fdb-5fdf8020f7b5. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:55:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating instance_info_cache with network_info: [{"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:55:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c5e6546c-2218-48f4-9182-11e10f01372d req-0488de73-d686-4f27-8f3b-2dbb669aae01 service nova] Releasing lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:55:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lazy-loading 'flavor' on Instance uuid f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-edebc96a-687f-4724-afb6-4453125de07e tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.190s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:55:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:55:55 user nova-compute[73079]: INFO nova.compute.manager [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attaching volume 988f9c03-adc3-45f0-951f-e075acf70fbc to /dev/vdb
Aug 17 14:55:55 user nova-compute[73079]: DEBUG os_brick.utils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[18baa730-4a0a-4ba9-9d68-ad949b7968c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80823c1-35d5-47e8-9c44-cbf304996534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd86ef8-d940-49ef-b10b-be811925ffdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f644be1-39ed-4348-9258-9f292ec20988]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:55:55 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:55:55 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba191de-3cbb-4fae-9190-14dae90f911a]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG os_brick.utils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:55:55 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating existing volume attachment record: c1d35c8c-8fd8-4c08-b0e3-3be6e714dbc3 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:55:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:55:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 14:56:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:56:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:03 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:56:03 user nova-compute[73079]: INFO nova.compute.claims [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Claim successful on node user
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:56:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.policy [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '735852ace093495aaf816e6cad97d813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44793ff31d0044ed921e6d2ab2f95e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:56:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Creating image(s)
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "/opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "/opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "/opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.224s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Successfully created port: d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk 1073741824" returned: 0 in 0.079s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Cannot resize image /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'migration_context' on Instance uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Ensure instance console log exists: /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Successfully updated port: d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquired lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-changed-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Refreshing instance network info cache due to event network-changed-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] Acquiring lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updating instance_info_cache with network_info: [{"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Releasing lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Instance network_info: |[{"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] Acquired lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.neutron [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Refreshing network info cache for port d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Start _get_guest_xml network_info=[{"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:56:06 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:56:06 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-519654046',display_name='tempest-VolumesSnapshotTestJSON-instance-519654046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-519654046',id=30,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2kRH4kYbgSM2fxiwswyqrVONle9VZIFhryA9pmCET2afdBsMFvu2j4AqaMpeoLz9stHm4VOzzX2ITLa5rm53qLoVAK9Em2SQgBflwknjWy9d+VMokKPYKjsOFs6q4/sg==',key_name='tempest-keypair-1347503780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44793ff31d0044ed921e6d2ab2f95e02',ramdisk_id='',reservation_id='r-l028krd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2084510521',owner_user_name='tempest-VolumesSnapshotTestJSON-2084510521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735852ace093495aaf816e6cad97d813',uuid=010c96fc-4eca-4af5-af52-412a3230c1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converting VIF {"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'pci_devices' on Instance uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:56:06 user nova-compute[73079]:   <uuid>010c96fc-4eca-4af5-af52-412a3230c1df</uuid>
Aug 17 14:56:06 user nova-compute[73079]:   <name>instance-0000001e</name>
Aug 17 14:56:06 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:56:06 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:56:06 user nova-compute[73079]:   <metadata>
Aug 17 14:56:06 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:56:06 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:56:06 user nova-compute[73079]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-519654046</nova:name>
Aug 17 14:56:06 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:56:06</nova:creationTime>
Aug 17 14:56:06 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:56:06 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:56:06 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:56:06 user nova-compute[73079]:       <nova:owner>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:user uuid="735852ace093495aaf816e6cad97d813">tempest-VolumesSnapshotTestJSON-2084510521-project-member</nova:user>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:project uuid="44793ff31d0044ed921e6d2ab2f95e02">tempest-VolumesSnapshotTestJSON-2084510521</nova:project>
Aug 17 14:56:06 user nova-compute[73079]:       </nova:owner>
Aug 17 14:56:06 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:56:06 user nova-compute[73079]:       <nova:ports>
Aug 17 14:56:06 user nova-compute[73079]:         <nova:port uuid="d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2">
Aug 17 14:56:06 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 14:56:06 user nova-compute[73079]:         </nova:port>
Aug 17 14:56:06 user nova-compute[73079]:       </nova:ports>
Aug 17 14:56:06 user nova-compute[73079]:     </nova:instance>
Aug 17 14:56:06 user nova-compute[73079]:   </metadata>
Aug 17 14:56:06 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:56:06 user nova-compute[73079]:     <system>
Aug 17 14:56:06 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:56:06 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:56:06 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:56:06 user nova-compute[73079]:       <entry name="serial">010c96fc-4eca-4af5-af52-412a3230c1df</entry>
Aug 17 14:56:06 user nova-compute[73079]:       <entry name="uuid">010c96fc-4eca-4af5-af52-412a3230c1df</entry>
Aug 17 14:56:06 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:56:06 user nova-compute[73079]:     </system>
Aug 17 14:56:06 user nova-compute[73079]:   </sysinfo>
Aug 17 14:56:06 user nova-compute[73079]:   <os>
Aug 17 14:56:06 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:56:06 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:56:06 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:56:06 user nova-compute[73079]:   </os>
Aug 17 14:56:06 user nova-compute[73079]:   <features>
Aug 17 14:56:06 user nova-compute[73079]:     <acpi/>
Aug 17 14:56:06 user nova-compute[73079]:     <apic/>
Aug 17 14:56:06 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:56:06 user nova-compute[73079]:   </features>
Aug 17 14:56:06 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:56:06 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:56:06 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:56:06 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:56:06 user nova-compute[73079]:   </clock>
Aug 17 14:56:06 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:56:06 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:56:06 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:56:06 user nova-compute[73079]:   </cpu>
Aug 17 14:56:06 user nova-compute[73079]:   <devices>
Aug 17 14:56:06 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:56:06 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:56:06 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk"/>
Aug 17 14:56:06 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:56:06 user nova-compute[73079]:     </disk>
Aug 17 14:56:06 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:56:06 user nova-compute[73079]:       <mac address="fa:16:3e:3e:36:36"/>
Aug 17 14:56:06 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:56:06 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:56:06 user nova-compute[73079]:       <target dev="tapd431d9cb-a1"/>
Aug 17 14:56:06 user nova-compute[73079]:     </interface>
Aug 17 14:56:06 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:56:06 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/console.log" append="off"/>
Aug 17 14:56:06 user nova-compute[73079]:     </serial>
Aug 17 14:56:06 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:56:06 user nova-compute[73079]:     <video>
Aug 17 14:56:06 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:56:06 user nova-compute[73079]:     </video>
Aug 17 14:56:06 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:56:06 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:56:06 user nova-compute[73079]:     </rng>
Aug 17 14:56:06 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:56:06 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:56:06 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:56:06 user nova-compute[73079]:     </memballoon>
Aug 17 14:56:06 user nova-compute[73079]:   </devices>
Aug 17 14:56:06 user nova-compute[73079]: </domain>
Aug 17 14:56:06 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-519654046',display_name='tempest-VolumesSnapshotTestJSON-instance-519654046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-519654046',id=30,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2kRH4kYbgSM2fxiwswyqrVONle9VZIFhryA9pmCET2afdBsMFvu2j4AqaMpeoLz9stHm4VOzzX2ITLa5rm53qLoVAK9Em2SQgBflwknjWy9d+VMokKPYKjsOFs6q4/sg==',key_name='tempest-keypair-1347503780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44793ff31d0044ed921e6d2ab2f95e02',ramdisk_id='',reservation_id='r-l028krd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2084510521',owner_user_name='tempest-VolumesSnapshotTestJSON-2084510521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735852ace093495aaf816e6cad97d813',uuid=010c96fc-4eca-4af5-af52-412a3230c1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converting VIF {"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG os_vif [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd431d9cb-a1, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd431d9cb-a1, col_values=(('external_ids', {'iface-id': 'd431d9cb-a15a-4c29-87bb-cdebfb4a4ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:36:36', 'vm-uuid': '010c96fc-4eca-4af5-af52-412a3230c1df'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:06 user nova-compute[73079]: INFO os_vif [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1')
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No VIF found with MAC fa:16:3e:3e:36:36, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:56:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG nova.network.neutron [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updated VIF entry in instance network info cache for port d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG nova.network.neutron [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updating instance_info_cache with network_info: [{"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1b69ed02-ba3d-46ab-a7ad-966defe06add req-71c633c5-0dc2-46c0-8655-3562e82ac393 service nova] Releasing lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJwxFUrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:56:07 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:56:07 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:56:07 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32a9acd-be41-4320-8012-71b42c46cb96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:56:07 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff786e-572f-4524-9d53-cc15eb280f67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc] added
Aug 17 14:56:07 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[047aa904-7346-4cd1-8ee9-734d948996fe]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba43f4c6-2f84-4937-930d-9a116a81e2b8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJwxFUrP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJwxFUrP" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b72151-d252-4f48-a102-939e1414b634]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJwxFUrP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e46080-1ae4-4090-8173-c2e91d445719]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[043861d9-ef83-4f13-bdc6-a6054fb1152d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14e231c-99fc-4000-9bcf-f544bd23c430]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260]
Aug 17 14:56:07 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260] successful.
Aug 17 14:56:07 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[20440ca5-4559-4248-ba5e-4ac84c1b48b3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2dfb0c-1fb3-4273-ac69-86d06b5d9fd3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:07 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:07 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:07 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca41cec-7e43-4316-8dc4-8755794552be]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:56:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJwxFUrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-ba36425d-9e4a-49df-a36e-3d3d9b378be2 req-99fd14fb-8203-4e4e-a0dc-cfdbcbcf87d9 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ba36425d-9e4a-49df-a36e-3d3d9b378be2 req-99fd14fb-8203-4e4e-a0dc-cfdbcbcf87d9 service nova] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ba36425d-9e4a-49df-a36e-3d3d9b378be2 req-99fd14fb-8203-4e4e-a0dc-cfdbcbcf87d9 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ba36425d-9e4a-49df-a36e-3d3d9b378be2 req-99fd14fb-8203-4e4e-a0dc-cfdbcbcf87d9 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-ba36425d-9e4a-49df-a36e-3d3d9b378be2 req-99fd14fb-8203-4e4e-a0dc-cfdbcbcf87d9 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] No waiting events found dispatching network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:08 user nova-compute[73079]: WARNING nova.compute.manager [req-ba36425d-9e4a-49df-a36e-3d3d9b378be2 req-99fd14fb-8203-4e4e-a0dc-cfdbcbcf87d9 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received unexpected event network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 for instance with vm_state building and task_state spawning.
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23963383961363961', 'path': '/dev/sdg'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963383961363961', 'path': '/dev/sdg'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:56:09 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:56:09 user nova-compute[73079]:   <source dev="/dev/sdg"/>
Aug 17 14:56:09 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:56:09 user nova-compute[73079]:   <serial>988f9c03-adc3-45f0-951f-e075acf70fbc</serial>
Aug 17 14:56:09 user nova-compute[73079]: </disk>
Aug 17 14:56:09 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No VIF found with MAC fa:16:3e:ca:e5:50, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:56:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1cf2d3b2-62c1-484d-81f4-e9e26b81963f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.598s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284170.3882017, 010c96fc-4eca-4af5-af52-412a3230c1df => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] VM Resumed (Lifecycle Event)
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Instance spawned successfully.
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284170.3894708, 010c96fc-4eca-4af5-af52-412a3230c1df => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] VM Started (Lifecycle Event)
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-d232ffa0-e01e-44bb-a424-2b990b3e447a req-205616db-4ec8-4e9d-81fb-ea61f30aab34 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d232ffa0-e01e-44bb-a424-2b990b3e447a req-205616db-4ec8-4e9d-81fb-ea61f30aab34 service nova] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d232ffa0-e01e-44bb-a424-2b990b3e447a req-205616db-4ec8-4e9d-81fb-ea61f30aab34 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d232ffa0-e01e-44bb-a424-2b990b3e447a req-205616db-4ec8-4e9d-81fb-ea61f30aab34 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-d232ffa0-e01e-44bb-a424-2b990b3e447a req-205616db-4ec8-4e9d-81fb-ea61f30aab34 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] No waiting events found dispatching network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:10 user nova-compute[73079]: WARNING nova.compute.manager [req-d232ffa0-e01e-44bb-a424-2b990b3e447a req-205616db-4ec8-4e9d-81fb-ea61f30aab34 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received unexpected event network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 for instance with vm_state building and task_state spawning.
Aug 17 14:56:10 user nova-compute[73079]: INFO nova.compute.manager [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Took 6.84 seconds to build instance.
Aug 17 14:56:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c16c4e22-4913-40b9-ad0f-23a40e9d1bdc tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.942s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:11 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:56:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:56:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-changed-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing instance network info cache due to event network-changed-fe741116-543b-4c4f-bb8a-93bfa769d439. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] Acquiring lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] Acquired lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Refreshing network info cache for port fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:56:17 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:56:18 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7442MB free_disk=25.339805603027344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance f25d4a41-0990-48b1-a2a9-fd3849526044 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3ef3f716-ed73-4478-b367-37ac0377df63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance d1f17d9d-7ffb-4b15-abdb-39c9b979118c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1115c466-99e9-408e-87c4-4fa6505d3eb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 874920b0-5183-4377-b2f7-46c9a65395c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 010c96fc-4eca-4af5-af52-412a3230c1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updated VIF entry in instance network info cache for port fe741116-543b-4c4f-bb8a-93bfa769d439. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [{"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-916af556-4c9c-40d3-b5cf-90d06234c992 req-344841db-36c1-4373-a6e0-0c0e44145842 service nova] Releasing lock "refresh_cache-3ef3f716-ed73-4478-b367-37ac0377df63" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:56:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:56:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:56:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.034s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "3ef3f716-ed73-4478-b367-37ac0377df63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:20 user nova-compute[73079]: INFO nova.compute.manager [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Terminating instance
Aug 17 14:56:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-e2a9b3f0-6e37-4165-afdb-8589637b33bd req-8b37d63a-6019-403c-b7b4-391a7dd331cc service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e2a9b3f0-6e37-4165-afdb-8589637b33bd req-8b37d63a-6019-403c-b7b4-391a7dd331cc service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e2a9b3f0-6e37-4165-afdb-8589637b33bd req-8b37d63a-6019-403c-b7b4-391a7dd331cc service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e2a9b3f0-6e37-4165-afdb-8589637b33bd req-8b37d63a-6019-403c-b7b4-391a7dd331cc service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-e2a9b3f0-6e37-4165-afdb-8589637b33bd req-8b37d63a-6019-403c-b7b4-391a7dd331cc service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-e2a9b3f0-6e37-4165-afdb-8589637b33bd req-8b37d63a-6019-403c-b7b4-391a7dd331cc service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-fe741116-543b-4c4f-bb8a-93bfa769d439 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-9d7d32b9-f56e-4281-953a-7cffc93a1d00 req-4fd0f179-cbc7-408f-a195-a22011c4d343 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9d7d32b9-f56e-4281-953a-7cffc93a1d00 req-4fd0f179-cbc7-408f-a195-a22011c4d343 service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9d7d32b9-f56e-4281-953a-7cffc93a1d00 req-4fd0f179-cbc7-408f-a195-a22011c4d343 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9d7d32b9-f56e-4281-953a-7cffc93a1d00 req-4fd0f179-cbc7-408f-a195-a22011c4d343 service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-9d7d32b9-f56e-4281-953a-7cffc93a1d00 req-4fd0f179-cbc7-408f-a195-a22011c4d343 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-9d7d32b9-f56e-4281-953a-7cffc93a1d00 req-4fd0f179-cbc7-408f-a195-a22011c4d343 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-27ad4ea6-d144-4936-90af-73058f811e5d for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-e30a47ab-c1cd-496b-90a4-7efe67ffd3c2 req-a7dae1cc-be66-428d-932c-63246687132d service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e30a47ab-c1cd-496b-90a4-7efe67ffd3c2 req-a7dae1cc-be66-428d-932c-63246687132d service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e30a47ab-c1cd-496b-90a4-7efe67ffd3c2 req-a7dae1cc-be66-428d-932c-63246687132d service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e30a47ab-c1cd-496b-90a4-7efe67ffd3c2 req-a7dae1cc-be66-428d-932c-63246687132d service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-e30a47ab-c1cd-496b-90a4-7efe67ffd3c2 req-a7dae1cc-be66-428d-932c-63246687132d service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-e30a47ab-c1cd-496b-90a4-7efe67ffd3c2 req-a7dae1cc-be66-428d-932c-63246687132d service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [{"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-d1f17d9d-7ffb-4b15-abdb-39c9b979118c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Instance destroyed successfully.
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lazy-loading 'resources' on Instance uuid 3ef3f716-ed73-4478-b367-37ac0377df63 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "fe741116-543b-4c4f-bb8a-93bfa769d439", "address": "fa:16:3e:85:91:df", "network": {"id": "bcad31a4-eadc-4cad-8b14-4e413b3f11dd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2075782530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe741116-54", "ovs_interfaceid": "fe741116-543b-4c4f-bb8a-93bfa769d439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe741116-54, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:91:df,bridge_name='br-int',has_traffic_filtering=True,id=fe741116-543b-4c4f-bb8a-93bfa769d439,network=Network(bcad31a4-eadc-4cad-8b14-4e413b3f11dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe741116-54')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27ad4ea6-d1, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:45,bridge_name='br-int',has_traffic_filtering=True,id=27ad4ea6-d144-4936-90af-73058f811e5d,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap27ad4ea6-d1')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd482be6-1c, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ae:7e,bridge_name='br-int',has_traffic_filtering=True,id=dd482be6-1cb0-439b-b987-a0e065f7df10,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd482be6-1c')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8ed6892-a9, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ee:e5,bridge_name='br-int',has_traffic_filtering=True,id=d8ed6892-a9cc-4354-8b33-35c98d05c029,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8ed6892-a9')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50304c3c-df, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:57:05,bridge_name='br-int',has_traffic_filtering=True,id=50304c3c-dfdf-4280-ab43-9db0cd6ca1f4,network=Network(d196e70b-0626-4588-bc51-b69d1a019ad6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50304c3c-df')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9251297b-0b, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:d1:b0,bridge_name='br-int',has_traffic_filtering=True,id=9251297b-0b58-4ea0-beec-283dcc2aa4bf,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9251297b-0b')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T14:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357057559',id=25,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfMltY0vpU5ms9TAKzANsK/HQIXAY76ujNeiZH7qYe1/5aYl2raBVHQoziAuoAERDxnhw+wWV3ZcwTa90Z0MA4vuLyuCWxCquNyDe06L8lN6DN9/h+S9WwI/aokEtHnZw==',key_name='tempest-keypair-1323630824',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbd1df658bf4985a76bd23a1ab2a8a5',ramdisk_id='',reservation_id='r-1m0z5j6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1762857507',owner_user_name='tempest-TaggedBootDevicesTest_v242-1762857507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5f41d1f2aac44178df8d963f84859d8',uuid=3ef3f716-ed73-4478-b367-37ac0377df63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converting VIF {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85fae322-4b, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:22 user nova-compute[73079]: INFO os_vif [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:04:4f,bridge_name='br-int',has_traffic_filtering=True,id=85fae322-4bb1-4dae-bbcf-452e5d492bb7,network=Network(54f31a63-1b21-4d6b-b0bd-9a77b1762eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fae322-4b')
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDOEpynG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:56:22 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[74940e27-2c5b-4de1-9650-f7985756ccf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4fdc94-7815-4f74-84c3-2438d2b95fbf]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:22 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c86677f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ed9c7-7889-4f94-963f-6ca01438312e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:22 user nova-compute[73079]: WARNING nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-fe741116-543b-4c4f-bb8a-93bfa769d439 for instance with vm_state active and task_state deleting.
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:22 user nova-compute[73079]: WARNING nova.compute.manager [req-420a15c0-898c-4524-b2ca-bd306835c117 req-e7d3cbf2-8aa8-4172-b156-3c44576c64ed service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-9251297b-0b58-4ea0-beec-283dcc2aa4bf for instance with vm_state active and task_state deleting.
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a332f87-0c8a-4aa9-8849-555cfb4f7b68]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3cd476-f53e-4c9c-bfa2-e23437a03884]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e781dc-29a6-432f-a15c-81b7269861f3]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4901442-fd77-4ba1-8d62-12cb66bfce0c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e2ccd-37f5-41a7-bd05-e6d89059ceea]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260]
Aug 17 14:56:22 user nova-compute[73079]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228, portal: 172.16.0.220,3260] successful.
Aug 17 14:56:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:003d8b35-b4f7-4883-921e-6254261f6228 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b82626-1f4d-4365-8d99-10b4b0bb0fa6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== disconnect_volume: return (331ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XarGDIvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:56:22 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10a53d6-2f81-473c-884e-1332bcbfb6a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df69a1-2217-4384-8bda-b16e7492efe1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c86677f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e034d9-062e-4667-8018-d503d96c0d1f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b9ac24-cbae-441f-8483-7a3c1d211603]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f537a65-71ef-4939-8d2e-3de859e71217]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f30d3b-a17b-4222-b3f5-c2bddba8daf3]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: WARNING nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-27ad4ea6-d144-4936-90af-73058f811e5d for instance with vm_state active and task_state deleting.
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-dd482be6-1cb0-439b-b987-a0e065f7df10 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: WARNING nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-dd482be6-1cb0-439b-b987-a0e065f7df10 for instance with vm_state active and task_state deleting.
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: WARNING nova.compute.manager [req-b6520854-703b-4676-a623-20ae78dff2b0 req-2583b9b8-61a1-4575-b458-6014b8ca67dd service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 for instance with vm_state active and task_state deleting.
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a233f4e-7f49-4211-8e69-37f133761c31]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: WARNING nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-d8ed6892-a9cc-4354-8b33-35c98d05c029 for instance with vm_state active and task_state deleting.
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-unplugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-unplugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Acquiring lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] Lock "3ef3f716-ed73-4478-b367-37ac0377df63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] No waiting events found dispatching network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:23 user nova-compute[73079]: WARNING nova.compute.manager [req-38968f4e-14e6-4423-b8b7-c5ecdb672dff req-0ef1abdd-510d-4035-8b93-1612d4fd252c service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received unexpected event network-vif-plugged-85fae322-4bb1-4dae-bbcf-452e5d492bb7 for instance with vm_state active and task_state deleting.
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1277b7c3-ba6b-4152-b9ed-9129a5cd8e5d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260]
Aug 17 14:56:23 user nova-compute[73079]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b, portal: 172.16.0.220,3260] successful.
Aug 17 14:56:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e702358-0c77-4cdc-b51d-e89e96a13d9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d578f8-9257-441e-bb72-50f075968b1f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== disconnect_volume: return (324ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOXpCdED', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:56:23 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf3af72-e7b1-43ee-92a8-0fe77e3ae538]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baa3337-c3cd-4d4f-99c0-8cbaf90dcdc5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:23 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c86677f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cc0f54-b771-4128-9826-c33600a03514]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b226112-2683-4363-890a-ae6d839d1271]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf65684-3494-46ae-a9c9-ac4518c27476]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25728a5-cf49-4c2c-9aca-f87faeb084dc]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc063f6-dab3-403b-8ffb-d67dceed9140]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3409745-43f8-4d09-aab4-2c126e42838b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260]
Aug 17 14:56:23 user nova-compute[73079]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55, portal: 172.16.0.220,3260] successful.
Aug 17 14:56:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79ec9e1e-3aa4-4202-8dc8-9367a7970d55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[38646270-f471-4ec5-a65f-9375773c3d57]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] <== disconnect_volume: return (297ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:56:23 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Deleting instance files /opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63_del
Aug 17 14:56:23 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Deletion of /opt/stack/data/nova/instances/3ef3f716-ed73-4478-b367-37ac0377df63_del complete
Aug 17 14:56:23 user nova-compute[73079]: INFO nova.compute.manager [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Took 3.33 seconds to destroy the instance on the hypervisor.
Aug 17 14:56:23 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:56:23 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:56:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-ce687b8f-fa3e-4070-92fb-1f712929f1d1 req-da6c0edc-ecdf-4285-8a14-a71d58c62109 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-deleted-fe741116-543b-4c4f-bb8a-93bfa769d439 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:25 user nova-compute[73079]: INFO nova.compute.manager [req-ce687b8f-fa3e-4070-92fb-1f712929f1d1 req-da6c0edc-ecdf-4285-8a14-a71d58c62109 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Neutron deleted interface fe741116-543b-4c4f-bb8a-93bfa769d439; detaching it from the instance and deleting it from the info cache
Aug 17 14:56:25 user nova-compute[73079]: DEBUG nova.network.neutron [req-ce687b8f-fa3e-4070-92fb-1f712929f1d1 req-da6c0edc-ecdf-4285-8a14-a71d58c62109 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [{"id": "27ad4ea6-d144-4936-90af-73058f811e5d", "address": "fa:16:3e:cb:d0:45", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ad4ea6-d1", "ovs_interfaceid": "27ad4ea6-d144-4936-90af-73058f811e5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dd482be6-1cb0-439b-b987-a0e065f7df10", "address": "fa:16:3e:ae:ae:7e", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd482be6-1c", "ovs_interfaceid": "dd482be6-1cb0-439b-b987-a0e065f7df10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "address": "fa:16:3e:5f:ee:e5", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8ed6892-a9", "ovs_interfaceid": "d8ed6892-a9cc-4354-8b33-35c98d05c029", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "address": "fa:16:3e:8d:57:05", "network": {"id": "d196e70b-0626-4588-bc51-b69d1a019ad6", "bridge": "br-int", "label": "tempest-device-tagging-net1-771213936", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50304c3c-df", "ovs_interfaceid": "50304c3c-dfdf-4280-ab43-9db0cd6ca1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "address": "fa:16:3e:40:d1:b0", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9251297b-0b", "ovs_interfaceid": "9251297b-0b58-4ea0-beec-283dcc2aa4bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "address": "fa:16:3e:8d:04:4f", "network": {"id": "54f31a63-1b21-4d6b-b0bd-9a77b1762eb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-609409669", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbd1df658bf4985a76bd23a1ab2a8a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fae322-4b", "ovs_interfaceid": "85fae322-4bb1-4dae-bbcf-452e5d492bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-ce687b8f-fa3e-4070-92fb-1f712929f1d1 req-da6c0edc-ecdf-4285-8a14-a71d58c62109 service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Detach interface failed, port_id=fe741116-543b-4c4f-bb8a-93bfa769d439, reason: Instance 3ef3f716-ed73-4478-b367-37ac0377df63 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:56:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:27 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:27 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Took 3.67 seconds to deallocate network for instance.
Aug 17 14:56:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-f0900c11-cf5a-4c15-aa28-695f9e0aba41 req-c6e6154f-cd03-41e7-aecb-5f3ca7c62d4f service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-deleted-50304c3c-dfdf-4280-ab43-9db0cd6ca1f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-f0900c11-cf5a-4c15-aa28-695f9e0aba41 req-c6e6154f-cd03-41e7-aecb-5f3ca7c62d4f service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-deleted-9251297b-0b58-4ea0-beec-283dcc2aa4bf {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-f0900c11-cf5a-4c15-aa28-695f9e0aba41 req-c6e6154f-cd03-41e7-aecb-5f3ca7c62d4f service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-deleted-85fae322-4bb1-4dae-bbcf-452e5d492bb7 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-f0900c11-cf5a-4c15-aa28-695f9e0aba41 req-c6e6154f-cd03-41e7-aecb-5f3ca7c62d4f service nova] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Received event network-vif-deleted-d8ed6892-a9cc-4354-8b33-35c98d05c029 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:29 user nova-compute[73079]: INFO nova.compute.manager [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Took 2.21 seconds to detach 3 volumes for instance.
Aug 17 14:56:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:29 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:56:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:56:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:29 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Deleted allocations for instance 3ef3f716-ed73-4478-b367-37ac0377df63
Aug 17 14:56:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-213dc962-89a7-4116-899f-73c8e0c2e8b0 tempest-TaggedBootDevicesTest_v242-1762857507 tempest-TaggedBootDevicesTest_v242-1762857507-project-member] Lock "3ef3f716-ed73-4478-b367-37ac0377df63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.666s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:37 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284182.1453292, 3ef3f716-ed73-4478-b367-37ac0377df63 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:56:37 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] VM Stopped (Lifecycle Event)
Aug 17 14:56:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-76aab598-2edd-47ff-9456-88eb0f3648e9 None None] [instance: 3ef3f716-ed73-4478-b367-37ac0377df63] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:56:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:39 user nova-compute[73079]: INFO nova.compute.manager [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Terminating instance
Aug 17 14:56:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-ebb0fcfb-a499-4811-8166-9bdd1157016b req-ec0f0714-2498-478b-8cca-5f8602bcc6c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-unplugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ebb0fcfb-a499-4811-8166-9bdd1157016b req-ec0f0714-2498-478b-8cca-5f8602bcc6c9 service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ebb0fcfb-a499-4811-8166-9bdd1157016b req-ec0f0714-2498-478b-8cca-5f8602bcc6c9 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ebb0fcfb-a499-4811-8166-9bdd1157016b req-ec0f0714-2498-478b-8cca-5f8602bcc6c9 service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-ebb0fcfb-a499-4811-8166-9bdd1157016b req-ec0f0714-2498-478b-8cca-5f8602bcc6c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-unplugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-ebb0fcfb-a499-4811-8166-9bdd1157016b req-ec0f0714-2498-478b-8cca-5f8602bcc6c9 service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-unplugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.compute.manager [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Detaching volume 988f9c03-adc3-45f0-951f-e075acf70fbc
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.virt.block_device [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attempting to driver detach volume 988f9c03-adc3-45f0-951f-e075acf70fbc from mountpoint /dev/vdb
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Attempting to detach device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:56:40 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:56:40 user nova-compute[73079]:   <source dev="/dev/sdg"/>
Aug 17 14:56:40 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:56:40 user nova-compute[73079]:   <serial>988f9c03-adc3-45f0-951f-e075acf70fbc</serial>
Aug 17 14:56:40 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:56:40 user nova-compute[73079]: </disk>
Aug 17 14:56:40 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config.
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:56:40 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:56:40 user nova-compute[73079]:   <source dev="/dev/sdg"/>
Aug 17 14:56:40 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:56:40 user nova-compute[73079]:   <serial>988f9c03-adc3-45f0-951f-e075acf70fbc</serial>
Aug 17 14:56:40 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:56:40 user nova-compute[73079]: </disk>
Aug 17 14:56:40 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284200.6603312, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config.
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJwxFUrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:56:40 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Instance destroyed successfully.
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lazy-loading 'resources' on Instance uuid d1f17d9d-7ffb-4b15-abdb-39c9b979118c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T14:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133672793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133672793',id=21,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARxs6R8GIWvCZaN27p04AKhZgUrXAz57K69xG6NJf9Q+kTa+6hilQRHmRPIa8CWGAITlhUfltflCBV22ywZcLP1Wl7eawRO05FCEuBq/7UWL1tBdCJeGScBFR0Fa7SS6w==',key_name='tempest-keypair-756591381',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:55:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb0da7dcf51b4267a38083a278e58ef9',ramdisk_id='',reservation_id='r-a1wbitbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-474259075',owner_user_name='tempest-AttachVolumeShelveTestJSON-474259075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb1feccca7d645ac90dff8f481bfe139',uuid=d1f17d9d-7ffb-4b15-abdb-39c9b979118c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converting VIF {"id": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "address": "fa:16:3e:be:9e:75", "network": {"id": "d1670de0-a172-4939-b6d0-613a4b3bf430", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-108005458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb0da7dcf51b4267a38083a278e58ef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape242a398-9d", "ovs_interfaceid": "e242a398-9deb-40de-bf4d-ff67ed34bba9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_vif [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41f57d8-11a5-4ba5-a97d-610530d29d65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape242a398-9d, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:56:40 user nova-compute[73079]: INFO os_vif [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:9e:75,bridge_name='br-int',has_traffic_filtering=True,id=e242a398-9deb-40de-bf4d-ff67ed34bba9,network=Network(d1670de0-a172-4939-b6d0-613a4b3bf430),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape242a398-9d')
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Deleting instance files /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c_del
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Deletion of /opt/stack/data/nova/instances/d1f17d9d-7ffb-4b15-abdb-39c9b979118c_del complete
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ad16ef-c905-4c86-9718-5532a633eb06]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:40 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:40 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:56:40 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:56:40 user nova-compute[73079]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc (non-flash)
Aug 17 14:56:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8729120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc'): ({'sdg'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Removing single pathed devices sdg {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f954b701-cc66-4aa5-8a85-94dc8e7c5f53]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: INFO nova.compute.manager [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d5fd8-8523-448b-b216-862788a95abf]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Flushing IO for device /dev/sdg {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba27f15-4344-499f-b7fc-9ba59a59b336]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[afede6ed-a54e-4d19-b2e4-34b1456a0d58]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] SCSI volumes sdg have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab51f31-d03a-434c-9eb9-b32b456554bf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c20032-b6af-49aa-a9a6-25e36f794eff]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260]
Aug 17 14:56:40 user nova-compute[73079]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc, portal: 172.16.0.220,3260] successful.
Aug 17 14:56:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:988f9c03-adc3-45f0-951f-e075acf70fbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d4a11-ef4d-418c-b216-035c7f092029]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== disconnect_volume: return (315ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:56:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-c8a85b3e-6ace-4712-ba63-46ab7c933607 req-0e1949dd-fd1c-443f-ab2d-5f09a8b1f5fd service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c8a85b3e-6ace-4712-ba63-46ab7c933607 req-0e1949dd-fd1c-443f-ab2d-5f09a8b1f5fd service nova] Acquiring lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c8a85b3e-6ace-4712-ba63-46ab7c933607 req-0e1949dd-fd1c-443f-ab2d-5f09a8b1f5fd service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c8a85b3e-6ace-4712-ba63-46ab7c933607 req-0e1949dd-fd1c-443f-ab2d-5f09a8b1f5fd service nova] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-c8a85b3e-6ace-4712-ba63-46ab7c933607 req-0e1949dd-fd1c-443f-ab2d-5f09a8b1f5fd service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] No waiting events found dispatching network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:42 user nova-compute[73079]: WARNING nova.compute.manager [req-c8a85b3e-6ace-4712-ba63-46ab7c933607 req-0e1949dd-fd1c-443f-ab2d-5f09a8b1f5fd service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received unexpected event network-vif-plugged-e242a398-9deb-40de-bf4d-ff67ed34bba9 for instance with vm_state active and task_state deleting.
Aug 17 14:56:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-changed-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Refreshing instance network info cache due to event network-changed-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] Acquiring lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] Acquired lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Refreshing network info cache for port 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:42 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Took 1.62 seconds to deallocate network for instance.
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updated VIF entry in instance network info cache for port 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating instance_info_cache with network_info: [{"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:42 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Deleted allocations for instance d1f17d9d-7ffb-4b15-abdb-39c9b979118c
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4aca3b32-8b72-42e5-a618-bfe1d7f1121b req-7c5c8340-b6fa-4db2-b297-76f1ada02d94 service nova] Releasing lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aca38562-1d34-4d0d-ab7b-ed87a386dc03 tempest-AttachVolumeShelveTestJSON-474259075 tempest-AttachVolumeShelveTestJSON-474259075-project-member] Lock "d1f17d9d-7ffb-4b15-abdb-39c9b979118c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-ce57d431-44cb-4136-9413-04f7db84e8e6 req-e2fe1971-9792-47af-847d-46434355171c service nova] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Received event network-vif-deleted-e242a398-9deb-40de-bf4d-ff67ed34bba9 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:45 user nova-compute[73079]: INFO nova.compute.manager [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Terminating instance
Aug 17 14:56:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d5c190f3-1e29-4d48-9be2-5c595e12de63 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.250s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-e8880390-6037-4b97-8da6-b8985920194d req-bb91eae1-aec5-4888-bec6-70e4d3c3e4ca service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-vif-unplugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e8880390-6037-4b97-8da6-b8985920194d req-bb91eae1-aec5-4888-bec6-70e4d3c3e4ca service nova] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e8880390-6037-4b97-8da6-b8985920194d req-bb91eae1-aec5-4888-bec6-70e4d3c3e4ca service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e8880390-6037-4b97-8da6-b8985920194d req-bb91eae1-aec5-4888-bec6-70e4d3c3e4ca service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-e8880390-6037-4b97-8da6-b8985920194d req-bb91eae1-aec5-4888-bec6-70e4d3c3e4ca service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] No waiting events found dispatching network-vif-unplugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-e8880390-6037-4b97-8da6-b8985920194d req-bb91eae1-aec5-4888-bec6-70e4d3c3e4ca service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-vif-unplugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:56:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Instance destroyed successfully.
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lazy-loading 'resources' on Instance uuid f25d4a41-0990-48b1-a2a9-fd3849526044 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1288181271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1288181',id=24,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCPJeuIAxVfiaXS8Y54+2wQZ5GzMsn5f4drLWcwnWvYC1AZTGziPWWdasjpCfDNnIbeBdF6bQPLNY5+UL8RebQtEtphFt7QbutAhxfHy7OHujuvwIRKH/KG+pQdCkejhw==',key_name='tempest-keypair-1922212375',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1639547e2c64318a67d2551533df958',ramdisk_id='',reservation_id='r-dramxteq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517511284',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c39dfbcb35f4931bd954af908be42c4',uuid=f25d4a41-0990-48b1-a2a9-fd3849526044,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Converting VIF {"id": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "address": "fa:16:3e:7a:53:23", "network": {"id": "45e6f2a0-9176-478a-833a-2d4849ce0cbb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1757409790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1639547e2c64318a67d2551533df958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d05a5a0-ca", "ovs_interfaceid": "6d05a5a0-ca5c-4036-ae62-30d073baa3e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG os_vif [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d05a5a0-ca, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:46 user nova-compute[73079]: INFO os_vif [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:53:23,bridge_name='br-int',has_traffic_filtering=True,id=6d05a5a0-ca5c-4036-ae62-30d073baa3e3,network=Network(45e6f2a0-9176-478a-833a-2d4849ce0cbb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d05a5a0-ca')
Aug 17 14:56:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Deleting instance files /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044_del
Aug 17 14:56:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Deletion of /opt/stack/data/nova/instances/f25d4a41-0990-48b1-a2a9-fd3849526044_del complete
Aug 17 14:56:46 user nova-compute[73079]: INFO nova.compute.manager [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 14:56:46 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:56:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:47 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:47 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Took 0.99 seconds to deallocate network for instance.
Aug 17 14:56:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:48 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Deleted allocations for instance f25d4a41-0990-48b1-a2a9-fd3849526044
Aug 17 14:56:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-dc955bab-0535-4168-be3b-dff12d2dec35 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284 tempest-TestServerVolumeAttachScenarioOldVersion-1517511284-project-member] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] Acquiring lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] Lock "f25d4a41-0990-48b1-a2a9-fd3849526044-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] No waiting events found dispatching network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:56:48 user nova-compute[73079]: WARNING nova.compute.manager [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received unexpected event network-vif-plugged-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 for instance with vm_state deleted and task_state None.
Aug 17 14:56:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-e3be6c06-18ad-4aba-b422-c10a46fcda97 req-20e62c09-5403-4276-9ace-9ffc44a4e638 service nova] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Received event network-vif-deleted-6d05a5a0-ca5c-4036-ae62-30d073baa3e3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:56:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:56:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:56:54 user nova-compute[73079]: INFO nova.compute.claims [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Claim successful on node user
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:56:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:56:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:56:54 user nova-compute[73079]: INFO nova.virt.block_device [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Booting with volume snapshot 0f15be1f-f8ee-4feb-b65b-428345b40d86 at /dev/vda
Aug 17 14:56:54 user nova-compute[73079]: DEBUG nova.policy [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '722f38129c96487b8331cde0ab317832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9478b753e2040e799f28e18c5a82223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Successfully created port: 7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284200.6779099, d1f17d9d-7ffb-4b15-abdb-39c9b979118c => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:56:55 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] VM Stopped (Lifecycle Event)
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-14a055ef-7a0a-478e-956e-b786e5b17ca7 None None] [instance: d1f17d9d-7ffb-4b15-abdb-39c9b979118c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Successfully updated port: 7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquired lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-changed-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Refreshing instance network info cache due to event network-changed-7629c56d-d568-435c-a763-e2f413e14628. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] Acquiring lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:56:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updating instance_info_cache with network_info: [{"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Releasing lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Instance network_info: |[{"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] Acquired lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG nova.network.neutron [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Refreshing network info cache for port 7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG nova.network.neutron [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updated VIF entry in instance network info cache for port 7629c56d-d568-435c-a763-e2f413e14628. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG nova.network.neutron [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updating instance_info_cache with network_info: [{"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f2e65e85-3c25-4448-84f6-ee4ca4d5eb31 req-dcc06262-2dc0-4d5e-be2a-ef468cca2509 service nova] Releasing lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:56:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:56:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG os_brick.utils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151b09a-2c0e-46e4-8aa5-bf2261dca45b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb759b9-447f-474b-852d-a47043d21260]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f6f6ef-5d52-4c31-8826-123313b4c091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[70144266-7eca-4add-a603-2d0858fbe2d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:00 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:57:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2cd176-9e66-4c21-af01-ca6c80503d81]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG os_brick.utils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:00 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updating existing volume attachment record: 809560ad-bdab-49c6-a938-c21f47d23992 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:57:01 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284206.6511638, f25d4a41-0990-48b1-a2a9-fd3849526044 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:57:01 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] VM Stopped (Lifecycle Event)
Aug 17 14:57:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9814572d-4217-421a-966a-8536756e9100 None None] [instance: f25d4a41-0990-48b1-a2a9-fd3849526044] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:03 user nova-compute[73079]: WARNING nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 1115c466-99e9-408e-87c4-4fa6505d3eb3 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:57:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 14:57:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:57:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 14:57:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:57:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Creating image(s)
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Ensure instance console log exists: /opt/stack/data/nova/instances/1e7950a1-4de8-43bc-a511-6e5d8c4b43e9/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Start _get_guest_xml network_info=[{"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T14:56:44Z,direct_url=<?>,disk_format='qcow2',id=bec3aa4d-f5e0-47f8-b175-9eff9bfa392a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1655882237',owner='c9478b753e2040e799f28e18c5a82223',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T14:56:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '809560ad-bdab-49c6-a938-c21f47d23992', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHlEvySJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e7950a1-4de8-43bc-a511-6e5d8c4b43e9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0882db4-3b9c-4d40-b315-9c3751673441', 'serial': 'c0882db4-3b9c-4d40-b315-9c3751673441'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:57:10 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:57:10 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T14:56:44Z,direct_url=<?>,disk_format='qcow2',id=bec3aa4d-f5e0-47f8-b175-9eff9bfa392a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1655882237',owner='c9478b753e2040e799f28e18c5a82223',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T14:56:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHlEvySJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:10 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:10 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:10 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[17423c9c-d7ce-43e2-a321-dafe3fce7797]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:57:10 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ac2cb7-59dd-42f1-907d-18f289b15970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441] added
Aug 17 14:57:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[db57dc2f-6ccb-4a78-9f0f-9564e29109c5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c544b422-4324-4537-b8c2-4608b56eac6a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHlEvySJ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHlEvySJ" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efdaf99-b36e-4f96-bb63-605c7fac5422]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHlEvySJ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a493fb78-a52b-4dde-82c0-5d7c80fcd168]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb994cb1-12fc-49dd-b65e-f9cd12d5e89d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8590ab0-c7f2-415f-9caf-95565a0d70ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260]
Aug 17 14:57:11 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260] successful.
Aug 17 14:57:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad66993a-f943-4339-bcd6-e3eca61b0182]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[116814ae-fbb5-4e27-8238-a33b1f682481]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[532da41f-ff5a-4ba0-b3f6-21f1fefd78be]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHlEvySJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:57:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26630336365383230', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630336365383230', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1219714311',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1219714311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1219714311',id=31,image_ref='bec3aa4d-f5e0-47f8-b175-9eff9bfa392a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHL9FLZvsKknXSiMa+qUQnpxM73Gh6tR75+RfhDRrN/OENcwGXAzDGliCoc9Yp6Ze2lXeRhBRwqSWANUQ3tODas8Mua9ZhrfZKq4qRvlW1Mug17h2ryyop48pjMuLF7sg==',key_name='tempest-keypair-1692675103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-j0br0qk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1112851866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:56:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='722f38129c96487b8331cde0ab317832',uuid=1e7950a1-4de8-43bc-a511-6e5d8c4b43e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:57:12 user nova-compute[73079]:   <uuid>1e7950a1-4de8-43bc-a511-6e5d8c4b43e9</uuid>
Aug 17 14:57:12 user nova-compute[73079]:   <name>instance-0000001f</name>
Aug 17 14:57:12 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:57:12 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:57:12 user nova-compute[73079]:   <metadata>
Aug 17 14:57:12 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:57:12 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:57:12 user nova-compute[73079]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1219714311</nova:name>
Aug 17 14:57:12 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:57:10</nova:creationTime>
Aug 17 14:57:12 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:57:12 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:57:12 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:57:12 user nova-compute[73079]:       <nova:owner>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:user uuid="722f38129c96487b8331cde0ab317832">tempest-TestVolumeBootPattern-1112851866-project-member</nova:user>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:project uuid="c9478b753e2040e799f28e18c5a82223">tempest-TestVolumeBootPattern-1112851866</nova:project>
Aug 17 14:57:12 user nova-compute[73079]:       </nova:owner>
Aug 17 14:57:12 user nova-compute[73079]:       <nova:root type="image" uuid="bec3aa4d-f5e0-47f8-b175-9eff9bfa392a"/>
Aug 17 14:57:12 user nova-compute[73079]:       <nova:ports>
Aug 17 14:57:12 user nova-compute[73079]:         <nova:port uuid="7629c56d-d568-435c-a763-e2f413e14628">
Aug 17 14:57:12 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 14:57:12 user nova-compute[73079]:         </nova:port>
Aug 17 14:57:12 user nova-compute[73079]:       </nova:ports>
Aug 17 14:57:12 user nova-compute[73079]:     </nova:instance>
Aug 17 14:57:12 user nova-compute[73079]:   </metadata>
Aug 17 14:57:12 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:57:12 user nova-compute[73079]:     <system>
Aug 17 14:57:12 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:57:12 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:57:12 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:57:12 user nova-compute[73079]:       <entry name="serial">1e7950a1-4de8-43bc-a511-6e5d8c4b43e9</entry>
Aug 17 14:57:12 user nova-compute[73079]:       <entry name="uuid">1e7950a1-4de8-43bc-a511-6e5d8c4b43e9</entry>
Aug 17 14:57:12 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:57:12 user nova-compute[73079]:     </system>
Aug 17 14:57:12 user nova-compute[73079]:   </sysinfo>
Aug 17 14:57:12 user nova-compute[73079]:   <os>
Aug 17 14:57:12 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:57:12 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:57:12 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:57:12 user nova-compute[73079]:   </os>
Aug 17 14:57:12 user nova-compute[73079]:   <features>
Aug 17 14:57:12 user nova-compute[73079]:     <acpi/>
Aug 17 14:57:12 user nova-compute[73079]:     <apic/>
Aug 17 14:57:12 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:57:12 user nova-compute[73079]:   </features>
Aug 17 14:57:12 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:57:12 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:57:12 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:57:12 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:57:12 user nova-compute[73079]:   </clock>
Aug 17 14:57:12 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:57:12 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:57:12 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:57:12 user nova-compute[73079]:   </cpu>
Aug 17 14:57:12 user nova-compute[73079]:   <devices>
Aug 17 14:57:12 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 14:57:12 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:12 user nova-compute[73079]:       <source dev="/dev/sdc"/>
Aug 17 14:57:12 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:57:12 user nova-compute[73079]:       <serial>c0882db4-3b9c-4d40-b315-9c3751673441</serial>
Aug 17 14:57:12 user nova-compute[73079]:     </disk>
Aug 17 14:57:12 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:57:12 user nova-compute[73079]:       <mac address="fa:16:3e:e5:09:25"/>
Aug 17 14:57:12 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:57:12 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:57:12 user nova-compute[73079]:       <target dev="tap7629c56d-d5"/>
Aug 17 14:57:12 user nova-compute[73079]:     </interface>
Aug 17 14:57:12 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:57:12 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/1e7950a1-4de8-43bc-a511-6e5d8c4b43e9/console.log" append="off"/>
Aug 17 14:57:12 user nova-compute[73079]:     </serial>
Aug 17 14:57:12 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:57:12 user nova-compute[73079]:     <video>
Aug 17 14:57:12 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:57:12 user nova-compute[73079]:     </video>
Aug 17 14:57:12 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:57:12 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:57:12 user nova-compute[73079]:     </rng>
Aug 17 14:57:12 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:57:12 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:57:12 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:57:12 user nova-compute[73079]:     </memballoon>
Aug 17 14:57:12 user nova-compute[73079]:   </devices>
Aug 17 14:57:12 user nova-compute[73079]: </domain>
Aug 17 14:57:12 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1219714311',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1219714311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1219714311',id=31,image_ref='bec3aa4d-f5e0-47f8-b175-9eff9bfa392a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHL9FLZvsKknXSiMa+qUQnpxM73Gh6tR75+RfhDRrN/OENcwGXAzDGliCoc9Yp6Ze2lXeRhBRwqSWANUQ3tODas8Mua9ZhrfZKq4qRvlW1Mug17h2ryyop48pjMuLF7sg==',key_name='tempest-keypair-1692675103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-j0br0qk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1112851866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:56:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='722f38129c96487b8331cde0ab317832',uuid=1e7950a1-4de8-43bc-a511-6e5d8c4b43e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG os_vif [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7629c56d-d5, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7629c56d-d5, col_values=(('external_ids', {'iface-id': '7629c56d-d568-435c-a763-e2f413e14628', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:09:25', 'vm-uuid': '1e7950a1-4de8-43bc-a511-6e5d8c4b43e9'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:12 user nova-compute[73079]: INFO os_vif [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5')
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No VIF found with MAC fa:16:3e:e5:09:25, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG nova.compute.manager [req-ec0f23ef-ca00-4312-adce-266fd6e2991a req-1efe9282-198b-4b18-add1-f7a0b1ebe24d service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ec0f23ef-ca00-4312-adce-266fd6e2991a req-1efe9282-198b-4b18-add1-f7a0b1ebe24d service nova] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ec0f23ef-ca00-4312-adce-266fd6e2991a req-1efe9282-198b-4b18-add1-f7a0b1ebe24d service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ec0f23ef-ca00-4312-adce-266fd6e2991a req-1efe9282-198b-4b18-add1-f7a0b1ebe24d service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG nova.compute.manager [req-ec0f23ef-ca00-4312-adce-266fd6e2991a req-1efe9282-198b-4b18-add1-f7a0b1ebe24d service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] No waiting events found dispatching network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:13 user nova-compute[73079]: WARNING nova.compute.manager [req-ec0f23ef-ca00-4312-adce-266fd6e2991a req-1efe9282-198b-4b18-add1-f7a0b1ebe24d service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received unexpected event network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 for instance with vm_state building and task_state spawning.
Aug 17 14:57:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284235.7481318, 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] VM Resumed (Lifecycle Event)
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Instance spawned successfully.
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284235.7484932, 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] VM Started (Lifecycle Event)
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-9f5195e5-3fb5-4398-bc28-159b0594e93c req-28eaaf5d-4f7c-4932-93a0-0b84c92dc832 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9f5195e5-3fb5-4398-bc28-159b0594e93c req-28eaaf5d-4f7c-4932-93a0-0b84c92dc832 service nova] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9f5195e5-3fb5-4398-bc28-159b0594e93c req-28eaaf5d-4f7c-4932-93a0-0b84c92dc832 service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9f5195e5-3fb5-4398-bc28-159b0594e93c req-28eaaf5d-4f7c-4932-93a0-0b84c92dc832 service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-9f5195e5-3fb5-4398-bc28-159b0594e93c req-28eaaf5d-4f7c-4932-93a0-0b84c92dc832 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] No waiting events found dispatching network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:15 user nova-compute[73079]: WARNING nova.compute.manager [req-9f5195e5-3fb5-4398-bc28-159b0594e93c req-28eaaf5d-4f7c-4932-93a0-0b84c92dc832 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received unexpected event network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 for instance with vm_state building and task_state spawning.
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Took 21.97 seconds to build instance.
Aug 17 14:57:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a701acfb-e69b-4880-8f13-34a67031abee tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.061s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.367s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:15 user nova-compute[73079]: INFO nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 17 14:57:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:57:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:57:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.356021881103516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1115c466-99e9-408e-87c4-4fa6505d3eb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 874920b0-5183-4377-b2f7-46c9a65395c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 010c96fc-4eca-4af5-af52-412a3230c1df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:57:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-changed-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Refreshing instance network info cache due to event network-changed-8fe47894-51f1-4803-8dd1-ad9f481df301. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] Acquiring lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] Acquired lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Refreshing network info cache for port 8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:57:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updated VIF entry in instance network info cache for port 8fe47894-51f1-4803-8dd1-ad9f481df301. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updating instance_info_cache with network_info: [{"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9b6d80b9-0565-4a5a-98e3-8dd10a450489 req-c672b0b3-f81f-4347-8719-8b356d1d3925 service nova] Releasing lock "refresh_cache-874920b0-5183-4377-b2f7-46c9a65395c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:57:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:57:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:25 user nova-compute[73079]: INFO nova.compute.manager [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Attaching volume 09ae0592-7db9-4563-841b-c43352af4bf2 to /dev/vdb
Aug 17 14:57:25 user nova-compute[73079]: DEBUG os_brick.utils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b13484-f8d0-437c-8af0-cf1def87c642]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f251f06-6193-4d82-81cf-7293384c390a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[14684348-780e-4249-8dac-98e353139ad7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b68d17-ea7e-4763-9f26-82d8aa56ca70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:25 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:57:25 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a1dbc-1df4-42b5-bae9-b4fd666f61a4]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG os_brick.utils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:25 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updating existing volume attachment record: a391ebde-e9bf-4f59-a45e-9db063ddc982 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:27 user nova-compute[73079]: INFO nova.compute.manager [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Unrescuing
Aug 17 14:57:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'flavor' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-7651083b-eb9e-4327-a8cc-bdeb8d4cc789 req-925b8dfd-e2e9-4466-bca5-a88761611fbc service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7651083b-eb9e-4327-a8cc-bdeb8d4cc789 req-925b8dfd-e2e9-4466-bca5-a88761611fbc service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7651083b-eb9e-4327-a8cc-bdeb8d4cc789 req-925b8dfd-e2e9-4466-bca5-a88761611fbc service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7651083b-eb9e-4327-a8cc-bdeb8d4cc789 req-925b8dfd-e2e9-4466-bca5-a88761611fbc service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-7651083b-eb9e-4327-a8cc-bdeb8d4cc789 req-925b8dfd-e2e9-4466-bca5-a88761611fbc service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:28 user nova-compute[73079]: WARNING nova.compute.manager [req-7651083b-eb9e-4327-a8cc-bdeb8d4cc789 req-925b8dfd-e2e9-4466-bca5-a88761611fbc service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance destroyed successfully.
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:30 user nova-compute[73079]: WARNING nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:30 user nova-compute[73079]: WARNING nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:30 user nova-compute[73079]: WARNING nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:30 user nova-compute[73079]: WARNING nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:30 user nova-compute[73079]: WARNING nova.compute.manager [req-c592700b-c903-443f-9f41-21661bd570de req-cd8778e6-d836-4827-9344-690253a6ed61 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:32 user nova-compute[73079]: WARNING nova.compute.manager [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:57:32 user nova-compute[73079]: WARNING nova.compute.manager [req-3d81d07a-42e3-41db-b87e-f963a5715862 req-3bbe36be-e2b4-4367-b10d-b5687ff2fdd1 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state rescued and task_state unrescuing.
Aug 17 14:57:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 168eb979-11c1-4643-a2e2-b160cbc5f150 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284252.4666274, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:57:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Resumed (Lifecycle Event)
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4b0c18d4-4523-45d3-b17b-db90fc023287 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:57:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284252.467351, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:57:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Started (Lifecycle Event)
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:57:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:34 user nova-compute[73079]: INFO nova.compute.manager [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attaching volume 2d212db0-2e63-4fdc-9634-0dc950880de6 to /dev/vdb
Aug 17 14:57:34 user nova-compute[73079]: DEBUG os_brick.utils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82689f-d265-412b-9b21-d1cbbe29083a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[448a652d-0ac1-4f85-9eb6-627aa19297c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1c90c-069f-4aa9-89e0-006523cf4889]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[74718521-eb10-4666-ab3a-2756e607f85a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:34 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:57:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cde7d63-df05-488a-a354-e71191d8e368]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG os_brick.utils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:34 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating existing volume attachment record: c91ebcd2-6793-48ff-9bbd-fd713e1495fb {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIvfXgMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:37 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:37 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:37 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35c00c-712e-4a0f-8e85-05e05abba5d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:57:37 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c54b6f-9f6d-4f24-8da5-3335a684eba9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2] added
Aug 17 14:57:37 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d012f99-8b26-405d-8f3d-c2f39500d0a4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba07a80-ae15-48ef-abd3-78831386a233]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIvfXgMd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIvfXgMd" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1707059-3a4d-4c3d-97be-6ad27c7a1bfa]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIvfXgMd'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3357733-2dd1-486b-a739-1c12486293c4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[52035e5b-f9fe-4e07-beb4-23f9d4a345de]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32fe7d-3dd6-4b16-8705-9c376f20eb9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260]
Aug 17 14:57:38 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260] successful.
Aug 17 14:57:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0f0fb-1993-4808-a534-90fc938eb57e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d3cbce-f4da-4a09-8843-7a81ca3bd2ed]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 (non-flash)
Aug 17 14:57:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50ad505-7206-4da9-b7e2-366502b5c651]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:57:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIvfXgMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26434373736316637', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434373736316637', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:57:39 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:39 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:57:39 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:57:39 user nova-compute[73079]:   <serial>09ae0592-7db9-4563-841b-c43352af4bf2</serial>
Aug 17 14:57:39 user nova-compute[73079]: </disk>
Aug 17 14:57:39 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:9a:4f:8e, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:57:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f975933a-d0df-47f2-b0e0-957c70e7bbbf tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.053s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:41 user nova-compute[73079]: INFO nova.compute.manager [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Detaching volume 09ae0592-7db9-4563-841b-c43352af4bf2
Aug 17 14:57:41 user nova-compute[73079]: INFO nova.virt.block_device [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Attempting to driver detach volume 09ae0592-7db9-4563-841b-c43352af4bf2 from mountpoint /dev/vdb
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Attempting to detach device vdb from instance 874920b0-5183-4377-b2f7-46c9a65395c4 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:57:41 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:41 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:57:41 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:57:41 user nova-compute[73079]:   <serial>09ae0592-7db9-4563-841b-c43352af4bf2</serial>
Aug 17 14:57:41 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:57:41 user nova-compute[73079]: </disk>
Aug 17 14:57:41 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:57:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully detached device vdb from instance 874920b0-5183-4377-b2f7-46c9a65395c4 from the persistent domain config.
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 874920b0-5183-4377-b2f7-46c9a65395c4 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:57:41 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:41 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:57:41 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:57:41 user nova-compute[73079]:   <serial>09ae0592-7db9-4563-841b-c43352af4bf2</serial>
Aug 17 14:57:41 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:57:41 user nova-compute[73079]: </disk>
Aug 17 14:57:41 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284261.878965, 874920b0-5183-4377-b2f7-46c9a65395c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:57:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully detached device vdb from instance 874920b0-5183-4377-b2f7-46c9a65395c4 from the live domain config.
Aug 17 14:57:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIvfXgMd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:41 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ce9635-7bdd-412d-9697-e5620fda6db6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[66959de1-9be0-4d88-851c-47455cb50945]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 (non-flash)
Aug 17 14:57:41 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e81beef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:57:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d5029-d0ec-410b-861a-750587a5ca61]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a457da-a532-43f1-a293-d752112ab4c4]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dd0ba2-645d-4bf7-8378-ee37f515c4ce]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed76fb-bfef-4b10-8798-e10b4b02b2d4]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2843b5d-7d87-4d24-9e5c-7bcc9dfe3a71]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e031a1-c58f-4421-abe1-d0d0f1eea74c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260]
Aug 17 14:57:42 user nova-compute[73079]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2, portal: 172.16.0.220,3260] successful.
Aug 17 14:57:42 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ae0592-7db9-4563-841b-c43352af4bf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd17e47f-0cf4-4805-86b1-f9fc9225f0f5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== disconnect_volume: return (365ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:57:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:43 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2acb73a6-c9cc-42df-a6eb-4686c3d8d922 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.935s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZgCXtHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:46 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ee4f4-2686-433a-a9fc-62907f505036]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:57:46 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265cf5d-394b-411a-a53e-c4e6dc12ea22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6] added
Aug 17 14:57:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbcb08e-3bbb-4de5-a363-bd8c58cf2eb8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880a61e-5fa4-4c3b-bff9-191af2b0d6e7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZgCXtHd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZgCXtHd" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbca707-ef22-44d2-8327-3863e13c87d9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YZgCXtHd'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4643e14-e700-412c-a80e-f37c153139ea]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4c9767-7f61-400e-8915-1d441f10f985]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[660cdc66-d092-4e14-8f9a-0a4d0c76fdc0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260]
Aug 17 14:57:46 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260] successful.
Aug 17 14:57:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddf2fbf-581a-4266-bae7-7f6c047e8ec5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e0e6d-388d-49c5-a1fc-de2146ac3fff]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 (non-flash)
Aug 17 14:57:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b454f3-bf0e-45a8-921e-8c49a005fd78]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:57:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZgCXtHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26330656664663934', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330656664663934', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:57:47 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:47 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:57:47 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:57:47 user nova-compute[73079]:   <serial>2d212db0-2e63-4fdc-9634-0dc950880de6</serial>
Aug 17 14:57:47 user nova-compute[73079]: </disk>
Aug 17 14:57:47 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:57:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:57:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:57:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No VIF found with MAC fa:16:3e:ca:e5:50, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:57:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-87bbe3c6-6b05-45bc-8b37-96df7a7ab148 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.852s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:50 user nova-compute[73079]: INFO nova.compute.manager [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Detaching volume 2d212db0-2e63-4fdc-9634-0dc950880de6
Aug 17 14:57:50 user nova-compute[73079]: INFO nova.virt.block_device [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attempting to driver detach volume 2d212db0-2e63-4fdc-9634-0dc950880de6 from mountpoint /dev/vdb
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Attempting to detach device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:57:50 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:50 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:57:50 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:57:50 user nova-compute[73079]:   <serial>2d212db0-2e63-4fdc-9634-0dc950880de6</serial>
Aug 17 14:57:50 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:57:50 user nova-compute[73079]: </disk>
Aug 17 14:57:50 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:57:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config.
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:57:50 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:57:50 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:57:50 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:57:50 user nova-compute[73079]:   <serial>2d212db0-2e63-4fdc-9634-0dc950880de6</serial>
Aug 17 14:57:50 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:57:50 user nova-compute[73079]: </disk>
Aug 17 14:57:50 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284270.936839, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:57:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config.
Aug 17 14:57:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZgCXtHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:50 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:57:50 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0aa840-0b18-4612-b381-662b59f94c08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491c917-2bb6-4195-89b9-e48db4e64994]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 (non-flash)
Aug 17 14:57:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c8404af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c61652-7769-4598-b708-de34061076e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71de8fd-31a8-4d0c-8ff7-6208cc391c6d]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f6a46-55a2-4a5c-a1a6-2d7c71438916]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[238581fa-9115-4c9e-b65f-86a95cc24f0a]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbea1cc-d11d-40e1-a3b2-63dcb499dae5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f183357a-72da-413e-97b2-2d2db7459c1e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260]
Aug 17 14:57:51 user nova-compute[73079]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6, portal: 172.16.0.220,3260] successful.
Aug 17 14:57:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d212db0-2e63-4fdc-9634-0dc950880de6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4969c93b-cc20-43f2-9267-bf8835ba68a4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== disconnect_volume: return (327ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:57:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8461668d-6e15-4a81-9436-511dbcb338f1 tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-changed-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Refreshing instance network info cache due to event network-changed-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] Acquiring lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] Acquired lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Refreshing network info cache for port d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updated VIF entry in instance network info cache for port d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updating instance_info_cache with network_info: [{"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:57:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-670254f8-7747-49a1-a1bb-3ff167289be2 req-1b959ea4-a587-408e-a38a-acdb3ff5027f service nova] Releasing lock "refresh_cache-010c96fc-4eca-4af5-af52-412a3230c1df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'flavor' on Instance uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:57:55 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Ignoring supplied device name: /dev/vdb
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:55 user nova-compute[73079]: INFO nova.compute.manager [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Attaching volume f7cafec7-91af-400d-ba2a-81694571069e to /dev/vdb
Aug 17 14:57:55 user nova-compute[73079]: DEBUG os_brick.utils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb135c44-b2c0-4437-b748-6ada91a98185]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b946b9-8bb7-43e5-9ee7-2eeb8f7af050]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.243s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[623edc6c-40cc-48ed-bbdd-c7e6dbe3b495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d8cfa-d712-408c-b90c-45f1d22eb926]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:57:56 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:57:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[93532f52-9e4d-46e7-bc8e-358875d8fd20]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG os_brick.utils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== get_connector_properties: return (494ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:57:56 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updating existing volume attachment record: 29b460e5-6c69-4ca8-b52d-e14aa657b83e {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:57:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:57:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:57:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:57:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:57:59 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:57:59 user nova-compute[73079]: INFO nova.compute.claims [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Claim successful on node user
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:58:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.policy [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcfb392dca9d4008b1ca9655cedaef6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13613dce4b924a33b76cdfac1a23cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:58:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Creating image(s)
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "/opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "/opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk 1073741824" returned: 0 in 0.047s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:58:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Cannot resize image /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'migration_context' on Instance uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Ensure instance console log exists: /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:01 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Successfully created port: bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Successfully updated port: bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-changed-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Refreshing instance network info cache due to event network-changed-bae76952-ee78-41c5-8587-39aa52f950f4. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Instance network_info: |[{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.neutron [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Refreshing network info cache for port bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Start _get_guest_xml network_info=[{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:58:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:58:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148204159',display_name='tempest-ServerActionsTestOtherA-server-148204159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148204159',id=32,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-705d5y5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=e7d185bd-dcc1-4ae4-91a6-b5684bcba937,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_devices' on Instance uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:58:02 user nova-compute[73079]:   <uuid>e7d185bd-dcc1-4ae4-91a6-b5684bcba937</uuid>
Aug 17 14:58:02 user nova-compute[73079]:   <name>instance-00000020</name>
Aug 17 14:58:02 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:58:02 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:58:02 user nova-compute[73079]:   <metadata>
Aug 17 14:58:02 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:58:02 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:58:02 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherA-server-148204159</nova:name>
Aug 17 14:58:02 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:58:02</nova:creationTime>
Aug 17 14:58:02 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:58:02 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:58:02 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:58:02 user nova-compute[73079]:       <nova:owner>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:user uuid="bcfb392dca9d4008b1ca9655cedaef6c">tempest-ServerActionsTestOtherA-1400100504-project-member</nova:user>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:project uuid="13613dce4b924a33b76cdfac1a23cb3c">tempest-ServerActionsTestOtherA-1400100504</nova:project>
Aug 17 14:58:02 user nova-compute[73079]:       </nova:owner>
Aug 17 14:58:02 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:58:02 user nova-compute[73079]:       <nova:ports>
Aug 17 14:58:02 user nova-compute[73079]:         <nova:port uuid="bae76952-ee78-41c5-8587-39aa52f950f4">
Aug 17 14:58:02 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 14:58:02 user nova-compute[73079]:         </nova:port>
Aug 17 14:58:02 user nova-compute[73079]:       </nova:ports>
Aug 17 14:58:02 user nova-compute[73079]:     </nova:instance>
Aug 17 14:58:02 user nova-compute[73079]:   </metadata>
Aug 17 14:58:02 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:58:02 user nova-compute[73079]:     <system>
Aug 17 14:58:02 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:58:02 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:58:02 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:58:02 user nova-compute[73079]:       <entry name="serial">e7d185bd-dcc1-4ae4-91a6-b5684bcba937</entry>
Aug 17 14:58:02 user nova-compute[73079]:       <entry name="uuid">e7d185bd-dcc1-4ae4-91a6-b5684bcba937</entry>
Aug 17 14:58:02 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:58:02 user nova-compute[73079]:     </system>
Aug 17 14:58:02 user nova-compute[73079]:   </sysinfo>
Aug 17 14:58:02 user nova-compute[73079]:   <os>
Aug 17 14:58:02 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:58:02 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:58:02 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:58:02 user nova-compute[73079]:   </os>
Aug 17 14:58:02 user nova-compute[73079]:   <features>
Aug 17 14:58:02 user nova-compute[73079]:     <acpi/>
Aug 17 14:58:02 user nova-compute[73079]:     <apic/>
Aug 17 14:58:02 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:58:02 user nova-compute[73079]:   </features>
Aug 17 14:58:02 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:58:02 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:58:02 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:58:02 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:58:02 user nova-compute[73079]:   </clock>
Aug 17 14:58:02 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:58:02 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:58:02 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:58:02 user nova-compute[73079]:   </cpu>
Aug 17 14:58:02 user nova-compute[73079]:   <devices>
Aug 17 14:58:02 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:58:02 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:58:02 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk"/>
Aug 17 14:58:02 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:58:02 user nova-compute[73079]:     </disk>
Aug 17 14:58:02 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:58:02 user nova-compute[73079]:       <mac address="fa:16:3e:0f:e7:98"/>
Aug 17 14:58:02 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:58:02 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:58:02 user nova-compute[73079]:       <target dev="tapbae76952-ee"/>
Aug 17 14:58:02 user nova-compute[73079]:     </interface>
Aug 17 14:58:02 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:58:02 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/console.log" append="off"/>
Aug 17 14:58:02 user nova-compute[73079]:     </serial>
Aug 17 14:58:02 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:58:02 user nova-compute[73079]:     <video>
Aug 17 14:58:02 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:58:02 user nova-compute[73079]:     </video>
Aug 17 14:58:02 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:58:02 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:58:02 user nova-compute[73079]:     </rng>
Aug 17 14:58:02 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:58:02 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:58:02 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:58:02 user nova-compute[73079]:     </memballoon>
Aug 17 14:58:02 user nova-compute[73079]:   </devices>
Aug 17 14:58:02 user nova-compute[73079]: </domain>
Aug 17 14:58:02 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148204159',display_name='tempest-ServerActionsTestOtherA-server-148204159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148204159',id=32,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-705d5y5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=e7d185bd-dcc1-4ae4-91a6-b5684bcba937,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG os_vif [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbae76952-ee, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbae76952-ee, col_values=(('external_ids', {'iface-id': 'bae76952-ee78-41c5-8587-39aa52f950f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:e7:98', 'vm-uuid': 'e7d185bd-dcc1-4ae4-91a6-b5684bcba937'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:02 user nova-compute[73079]: INFO os_vif [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee')
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:58:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No VIF found with MAC fa:16:3e:0f:e7:98, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:58:03 user nova-compute[73079]: DEBUG nova.network.neutron [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated VIF entry in instance network info cache for port bae76952-ee78-41c5-8587-39aa52f950f4. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:58:03 user nova-compute[73079]: DEBUG nova.network.neutron [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c7e45d21-5712-43a5-a041-d501f9e2872b req-54e11942-6944-4e59-b2a8-1b8c121ed741 service nova] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2698dd6-55c6-4834-a0e2-6c59bcda59c4 req-f53666d0-2548-4b24-ae41-1848095da41b service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2698dd6-55c6-4834-a0e2-6c59bcda59c4 req-f53666d0-2548-4b24-ae41-1848095da41b service nova] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2698dd6-55c6-4834-a0e2-6c59bcda59c4 req-f53666d0-2548-4b24-ae41-1848095da41b service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2698dd6-55c6-4834-a0e2-6c59bcda59c4 req-f53666d0-2548-4b24-ae41-1848095da41b service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2698dd6-55c6-4834-a0e2-6c59bcda59c4 req-f53666d0-2548-4b24-ae41-1848095da41b service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] No waiting events found dispatching network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:04 user nova-compute[73079]: WARNING nova.compute.manager [req-a2698dd6-55c6-4834-a0e2-6c59bcda59c4 req-f53666d0-2548-4b24-ae41-1848095da41b service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received unexpected event network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 for instance with vm_state building and task_state spawning.
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284286.4078681, e7d185bd-dcc1-4ae4-91a6-b5684bcba937 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] VM Resumed (Lifecycle Event)
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Instance spawned successfully.
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284286.4092357, e7d185bd-dcc1-4ae4-91a6-b5684bcba937 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] VM Started (Lifecycle Event)
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-b705e702-4f4a-4e84-bb6e-b82dc68ad3f0 req-18e4dcbe-48b4-4a10-b562-6deaf89a2f0d service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b705e702-4f4a-4e84-bb6e-b82dc68ad3f0 req-18e4dcbe-48b4-4a10-b562-6deaf89a2f0d service nova] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b705e702-4f4a-4e84-bb6e-b82dc68ad3f0 req-18e4dcbe-48b4-4a10-b562-6deaf89a2f0d service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b705e702-4f4a-4e84-bb6e-b82dc68ad3f0 req-18e4dcbe-48b4-4a10-b562-6deaf89a2f0d service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-b705e702-4f4a-4e84-bb6e-b82dc68ad3f0 req-18e4dcbe-48b4-4a10-b562-6deaf89a2f0d service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] No waiting events found dispatching network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:06 user nova-compute[73079]: WARNING nova.compute.manager [req-b705e702-4f4a-4e84-bb6e-b82dc68ad3f0 req-18e4dcbe-48b4-4a10-b562-6deaf89a2f0d service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received unexpected event network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 for instance with vm_state building and task_state spawning.
Aug 17 14:58:06 user nova-compute[73079]: INFO nova.compute.manager [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Took 6.96 seconds to build instance.
Aug 17 14:58:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d07b09a4-0f4e-43e9-a6e9-3f709884fc5d tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfwJcVTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:58:08 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:58:08 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:58:08 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[40221a9f-1f2a-4133-94df-345779d14dd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:58:08 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c500541-6c96-414f-a218-d06b7ac0982f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e] added
Aug 17 14:58:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[45911b36-52d2-4148-bc60-9298571b7bda]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[104aeaae-f7ff-42e6-94ef-3f412f06ba8c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfwJcVTy {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfwJcVTy" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bcd54e-f75d-4c76-8c0d-36d579fb3cf9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfwJcVTy'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dbdc17-dd01-460e-894d-d3c7da43cca3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e309d024-89f7-4099-aabb-950e3b574fc8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7a400-3b26-4b2d-9c01-ad744ce2f5d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260]
Aug 17 14:58:08 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260] successful.
Aug 17 14:58:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[97478d52-1068-42ae-b4d3-811ce89acfd0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b020c8-c0cf-4b05-9cf2-2dda3f2be51d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)
Aug 17 14:58:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:58:08 user nova-compute[73079]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)
Aug 17 14:58:08 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[70baac9f-41ff-4ecf-a73e-2e9b0f12afc3]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:08 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfwJcVTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23933333963633933', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933333963633933', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'flavor' on Instance uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:58:09 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:58:09 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:58:09 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:58:09 user nova-compute[73079]:   <serial>f7cafec7-91af-400d-ba2a-81694571069e</serial>
Aug 17 14:58:09 user nova-compute[73079]: </disk>
Aug 17 14:58:09 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:58:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:58:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:58:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No VIF found with MAC fa:16:3e:3e:36:36, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:58:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-44e9ffc3-58c7-4fa8-88ae-d02b335f3d32 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.562s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:13 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:58:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:58:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:58:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:58:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7859MB free_disk=25.326950073242188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1115c466-99e9-408e-87c4-4fa6505d3eb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 874920b0-5183-4377-b2f7-46c9a65395c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 010c96fc-4eca-4af5-af52-412a3230c1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:58:19 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:58:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:58:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating instance_info_cache with network_info: [{"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-e1bec80a-f4a5-4df0-b02d-660865f4e0a7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:58:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:58:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:31 user nova-compute[73079]: INFO nova.compute.manager [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Terminating instance
Aug 17 14:58:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-1d09f627-720a-47d0-9257-ee6fee0886f9 req-2d1e1056-531f-482a-8519-6d26e5cd4dd3 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-vif-unplugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1d09f627-720a-47d0-9257-ee6fee0886f9 req-2d1e1056-531f-482a-8519-6d26e5cd4dd3 service nova] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1d09f627-720a-47d0-9257-ee6fee0886f9 req-2d1e1056-531f-482a-8519-6d26e5cd4dd3 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1d09f627-720a-47d0-9257-ee6fee0886f9 req-2d1e1056-531f-482a-8519-6d26e5cd4dd3 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-1d09f627-720a-47d0-9257-ee6fee0886f9 req-2d1e1056-531f-482a-8519-6d26e5cd4dd3 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] No waiting events found dispatching network-vif-unplugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-1d09f627-720a-47d0-9257-ee6fee0886f9 req-2d1e1056-531f-482a-8519-6d26e5cd4dd3 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-vif-unplugged-8fe47894-51f1-4803-8dd1-ad9f481df301 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Instance destroyed successfully.
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'resources' on Instance uuid 874920b0-5183-4377-b2f7-46c9a65395c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1774340719',display_name='tempest-AttachVolumeNegativeTest-server-1774340719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1774340719',id=29,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/w3zmNcNwqoSDPAkRYR5I9Yyux3yr7yxs91etvcnpIKFW+fSr3/f5M0MXtALRqvXLyWTZyYeeakyfz7GVKCdpwuyS5yqenk8S2P6/aTbazDdmUOp8MhInztaWYOrI0ow==',key_name='tempest-keypair-163331995',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-jfh11y9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=874920b0-5183-4377-b2f7-46c9a65395c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "8fe47894-51f1-4803-8dd1-ad9f481df301", "address": "fa:16:3e:9a:4f:8e", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe47894-51", "ovs_interfaceid": "8fe47894-51f1-4803-8dd1-ad9f481df301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG os_vif [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe47894-51, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:58:32 user nova-compute[73079]: INFO os_vif [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:4f:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fe47894-51f1-4803-8dd1-ad9f481df301,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe47894-51')
Aug 17 14:58:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Deleting instance files /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4_del
Aug 17 14:58:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Deletion of /opt/stack/data/nova/instances/874920b0-5183-4377-b2f7-46c9a65395c4_del complete
Aug 17 14:58:32 user nova-compute[73079]: INFO nova.compute.manager [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 14:58:32 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:58:32 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:33 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Took 1.01 seconds to deallocate network for instance.
Aug 17 14:58:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-97868390-147a-4f2d-a2a5-51c36bd4f22c req-91255872-6923-4751-9eac-841cb7781756 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-vif-deleted-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:33 user nova-compute[73079]: INFO nova.compute.manager [req-97868390-147a-4f2d-a2a5-51c36bd4f22c req-91255872-6923-4751-9eac-841cb7781756 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Neutron deleted interface 8fe47894-51f1-4803-8dd1-ad9f481df301; detaching it from the instance and deleting it from the info cache
Aug 17 14:58:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-97868390-147a-4f2d-a2a5-51c36bd4f22c req-91255872-6923-4751-9eac-841cb7781756 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-97868390-147a-4f2d-a2a5-51c36bd4f22c req-91255872-6923-4751-9eac-841cb7781756 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Detach interface failed, port_id=8fe47894-51f1-4803-8dd1-ad9f481df301, reason: Instance 874920b0-5183-4377-b2f7-46c9a65395c4 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:58:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:34 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Deleted allocations for instance 874920b0-5183-4377-b2f7-46c9a65395c4
Aug 17 14:58:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2eb9edfe-f8d5-4db5-99fa-eeb3706a225c tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "874920b0-5183-4377-b2f7-46c9a65395c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.404s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-4882a86a-e90a-4029-994a-fef404eb315f req-9fa53f1b-9b1a-4a5f-b015-2ae4d1b9eb85 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received event network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4882a86a-e90a-4029-994a-fef404eb315f req-9fa53f1b-9b1a-4a5f-b015-2ae4d1b9eb85 service nova] Acquiring lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4882a86a-e90a-4029-994a-fef404eb315f req-9fa53f1b-9b1a-4a5f-b015-2ae4d1b9eb85 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4882a86a-e90a-4029-994a-fef404eb315f req-9fa53f1b-9b1a-4a5f-b015-2ae4d1b9eb85 service nova] Lock "874920b0-5183-4377-b2f7-46c9a65395c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-4882a86a-e90a-4029-994a-fef404eb315f req-9fa53f1b-9b1a-4a5f-b015-2ae4d1b9eb85 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] No waiting events found dispatching network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:34 user nova-compute[73079]: WARNING nova.compute.manager [req-4882a86a-e90a-4029-994a-fef404eb315f req-9fa53f1b-9b1a-4a5f-b015-2ae4d1b9eb85 service nova] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Received unexpected event network-vif-plugged-8fe47894-51f1-4803-8dd1-ad9f481df301 for instance with vm_state deleted and task_state None.
Aug 17 14:58:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-changed-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Refreshing instance network info cache due to event network-changed-7629c56d-d568-435c-a763-e2f413e14628. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] Acquiring lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] Acquired lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Refreshing network info cache for port 7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:45 user nova-compute[73079]: INFO nova.compute.manager [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attaching volume b8007e3d-cbe6-4b0c-9891-12801dffa689 to /dev/vdb
Aug 17 14:58:45 user nova-compute[73079]: DEBUG os_brick.utils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da260cf-5f3d-4f8c-b20d-42b97752b95e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf122c7a-d033-433d-a0d5-51cb41cc5d74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d56b47-fe1a-464a-8d56-ffdad814d975]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9689dbb-6507-41be-9a59-7c37e7372b06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 14:58:46 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b70218-17f2-4e9e-85b7-24c65662ac02]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.utils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating existing volume attachment record: 28df346b-efa4-4c2b-bcc4-a3f25727952c {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:46 user nova-compute[73079]: INFO nova.compute.manager [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Terminating instance
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updated VIF entry in instance network info cache for port 7629c56d-d568-435c-a763-e2f413e14628. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updating instance_info_cache with network_info: [{"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-250d5f93-9e3d-430a-9609-52b61a1dc95a req-aea425f3-61c9-467f-b284-9fe6bff554d7 service nova] Releasing lock "refresh_cache-1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a865f11-dde2-4b38-986c-1bdf0f514379 req-b1e3e5e9-a243-4595-a1c5-d779d613cf22 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-vif-unplugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a865f11-dde2-4b38-986c-1bdf0f514379 req-b1e3e5e9-a243-4595-a1c5-d779d613cf22 service nova] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a865f11-dde2-4b38-986c-1bdf0f514379 req-b1e3e5e9-a243-4595-a1c5-d779d613cf22 service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a865f11-dde2-4b38-986c-1bdf0f514379 req-b1e3e5e9-a243-4595-a1c5-d779d613cf22 service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a865f11-dde2-4b38-986c-1bdf0f514379 req-b1e3e5e9-a243-4595-a1c5-d779d613cf22 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] No waiting events found dispatching network-vif-unplugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a865f11-dde2-4b38-986c-1bdf0f514379 req-b1e3e5e9-a243-4595-a1c5-d779d613cf22 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-vif-unplugged-7629c56d-d568-435c-a763-e2f413e14628 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Instance destroyed successfully.
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'resources' on Instance uuid 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:56:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1219714311',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1219714311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1219714311',id=31,image_ref='bec3aa4d-f5e0-47f8-b175-9eff9bfa392a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHL9FLZvsKknXSiMa+qUQnpxM73Gh6tR75+RfhDRrN/OENcwGXAzDGliCoc9Yp6Ze2lXeRhBRwqSWANUQ3tODas8Mua9ZhrfZKq4qRvlW1Mug17h2ryyop48pjMuLF7sg==',key_name='tempest-keypair-1692675103',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-j0br0qk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1112851866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='722f38129c96487b8331cde0ab317832',uuid=1e7950a1-4de8-43bc-a511-6e5d8c4b43e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "7629c56d-d568-435c-a763-e2f413e14628", "address": "fa:16:3e:e5:09:25", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7629c56d-d5", "ovs_interfaceid": "7629c56d-d568-435c-a763-e2f413e14628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_vif [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7629c56d-d5, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:58:46 user nova-compute[73079]: INFO os_vif [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:09:25,bridge_name='br-int',has_traffic_filtering=True,id=7629c56d-d568-435c-a763-e2f413e14628,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7629c56d-d5')
Aug 17 14:58:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHlEvySJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:58:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:58:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63775a9-2005-4108-924b-6472ceb8753c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57a1e056-3b59-433a-b937-b3af8def0723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9496159d-1d8d-44f9-b860-cd06d374945d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49fdc7c-9810-4cef-8790-8d4152a71043]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a1e056-3b59-433a-b937-b3af8def0723 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9496159d-1d8d-44f9-b860-cd06d374945d (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a1e056-3b59-433a-b937-b3af8def0723 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9496159d-1d8d-44f9-b860-cd06d374945d (non-flash)
Aug 17 14:58:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57a1e056-3b59-433a-b937-b3af8def0723 (non-flash)
Aug 17 14:58:47 user nova-compute[73079]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9496159d-1d8d-44f9-b860-cd06d374945d (non-flash)
Aug 17 14:58:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e831d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681e804-8083-490b-8f22-129d032eb4da]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6283be14-0d8d-4342-9753-88510ad6f302]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac9d72-bed6-4f5c-bd8b-8f97754aa000]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f4484-7d95-47c6-afbe-140c1c76264b]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ce35a-7840-4ea5-9caa-f920e6acb32a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b3a6b-d5a6-4860-b49d-04b063ce02b4]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260]
Aug 17 14:58:47 user nova-compute[73079]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441, portal: 172.16.0.220,3260] successful.
Aug 17 14:58:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0882db4-3b9c-4d40-b315-9c3751673441 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b7a7c8-3fcc-4c0e-9103-92cdc187ca26]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== disconnect_volume: return (410ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:58:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Deleting instance files /opt/stack/data/nova/instances/1e7950a1-4de8-43bc-a511-6e5d8c4b43e9_del
Aug 17 14:58:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Deletion of /opt/stack/data/nova/instances/1e7950a1-4de8-43bc-a511-6e5d8c4b43e9_del complete
Aug 17 14:58:47 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284312.4784791, 874920b0-5183-4377-b2f7-46c9a65395c4 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:58:47 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] VM Stopped (Lifecycle Event)
Aug 17 14:58:47 user nova-compute[73079]: INFO nova.compute.manager [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 17 14:58:47 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:58:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5cad999f-c5b9-4482-a63b-a676b2917121 None None] [instance: 874920b0-5183-4377-b2f7-46c9a65395c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-65819835-340f-4c4b-aa91-ec2e97147504 req-c381d996-8b52-4242-9463-61db68154713 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-65819835-340f-4c4b-aa91-ec2e97147504 req-c381d996-8b52-4242-9463-61db68154713 service nova] Acquiring lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-65819835-340f-4c4b-aa91-ec2e97147504 req-c381d996-8b52-4242-9463-61db68154713 service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-65819835-340f-4c4b-aa91-ec2e97147504 req-c381d996-8b52-4242-9463-61db68154713 service nova] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-65819835-340f-4c4b-aa91-ec2e97147504 req-c381d996-8b52-4242-9463-61db68154713 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] No waiting events found dispatching network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:49 user nova-compute[73079]: WARNING nova.compute.manager [req-65819835-340f-4c4b-aa91-ec2e97147504 req-c381d996-8b52-4242-9463-61db68154713 service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received unexpected event network-vif-plugged-7629c56d-d568-435c-a763-e2f413e14628 for instance with vm_state active and task_state deleting.
Aug 17 14:58:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:49 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Took 2.25 seconds to deallocate network for instance.
Aug 17 14:58:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-1f017425-5c00-45d4-a2e5-b352ca7b5074 req-2a883854-f9dd-4ab0-88ef-f0e7043a655f service nova] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Received event network-vif-deleted-7629c56d-d568-435c-a763-e2f413e14628 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:50 user nova-compute[73079]: INFO nova.compute.manager [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Took 1.05 seconds to detach 1 volumes for instance.
Aug 17 14:58:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Deleting volume: c0882db4-3b9c-4d40-b315-9c3751673441 {{(pid=73079) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 14:58:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:51 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Deleted allocations for instance 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "798284c1-c697-4048-a9e6-382efa5ee684" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3bb88de3-3a47-4486-8a4e-f1ab12a7b93a tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1e7950a1-4de8-43bc-a511-6e5d8c4b43e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.402s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:58:51 user nova-compute[73079]: INFO nova.compute.claims [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Claim successful on node user
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:58:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:58:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG nova.policy [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8aacbb819abc4ff080673f4a1a1314f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ea26ddbec745688fc8d2b4e64f6189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:58:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Creating image(s)
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "/opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "/opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "/opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.226s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk 1073741824" returned: 0 in 0.052s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Successfully created port: ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Checking if we can resize image /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:58:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Cannot resize image /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lazy-loading 'migration_context' on Instance uuid 798284c1-c697-4048-a9e6-382efa5ee684 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Ensure instance console log exists: /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Successfully updated port: ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "refresh_cache-798284c1-c697-4048-a9e6-382efa5ee684" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquired lock "refresh_cache-798284c1-c697-4048-a9e6-382efa5ee684" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-changed-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Refreshing instance network info cache due to event network-changed-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] Acquiring lock "refresh_cache-798284c1-c697-4048-a9e6-382efa5ee684" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Updating instance_info_cache with network_info: [{"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Releasing lock "refresh_cache-798284c1-c697-4048-a9e6-382efa5ee684" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Instance network_info: |[{"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] Acquired lock "refresh_cache-798284c1-c697-4048-a9e6-382efa5ee684" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.network.neutron [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Refreshing network info cache for port ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Start _get_guest_xml network_info=[{"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:58:53 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:58:53 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:58:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1300453686',display_name='tempest-VolumesActionsTest-instance-1300453686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1300453686',id=33,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ea26ddbec745688fc8d2b4e64f6189',ramdisk_id='',reservation_id='r-pb0y784c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1721904385',owner_user_name='tempest-VolumesActionsTest-1721904385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:58:52Z,user_data=None,user_id='8aacbb819abc4ff080673f4a1a1314f7',uuid=798284c1-c697-4048-a9e6-382efa5ee684,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Converting VIF {"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lazy-loading 'pci_devices' on Instance uuid 798284c1-c697-4048-a9e6-382efa5ee684 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:58:54 user nova-compute[73079]:   <uuid>798284c1-c697-4048-a9e6-382efa5ee684</uuid>
Aug 17 14:58:54 user nova-compute[73079]:   <name>instance-00000021</name>
Aug 17 14:58:54 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:58:54 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:58:54 user nova-compute[73079]:   <metadata>
Aug 17 14:58:54 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:58:54 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:58:54 user nova-compute[73079]:       <nova:name>tempest-VolumesActionsTest-instance-1300453686</nova:name>
Aug 17 14:58:54 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:58:53</nova:creationTime>
Aug 17 14:58:54 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:58:54 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:58:54 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:58:54 user nova-compute[73079]:       <nova:owner>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:user uuid="8aacbb819abc4ff080673f4a1a1314f7">tempest-VolumesActionsTest-1721904385-project-member</nova:user>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:project uuid="c0ea26ddbec745688fc8d2b4e64f6189">tempest-VolumesActionsTest-1721904385</nova:project>
Aug 17 14:58:54 user nova-compute[73079]:       </nova:owner>
Aug 17 14:58:54 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:58:54 user nova-compute[73079]:       <nova:ports>
Aug 17 14:58:54 user nova-compute[73079]:         <nova:port uuid="ccb63dda-1ca2-4601-bcc6-414c7bf1acdb">
Aug 17 14:58:54 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 14:58:54 user nova-compute[73079]:         </nova:port>
Aug 17 14:58:54 user nova-compute[73079]:       </nova:ports>
Aug 17 14:58:54 user nova-compute[73079]:     </nova:instance>
Aug 17 14:58:54 user nova-compute[73079]:   </metadata>
Aug 17 14:58:54 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:58:54 user nova-compute[73079]:     <system>
Aug 17 14:58:54 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:58:54 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:58:54 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:58:54 user nova-compute[73079]:       <entry name="serial">798284c1-c697-4048-a9e6-382efa5ee684</entry>
Aug 17 14:58:54 user nova-compute[73079]:       <entry name="uuid">798284c1-c697-4048-a9e6-382efa5ee684</entry>
Aug 17 14:58:54 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:58:54 user nova-compute[73079]:     </system>
Aug 17 14:58:54 user nova-compute[73079]:   </sysinfo>
Aug 17 14:58:54 user nova-compute[73079]:   <os>
Aug 17 14:58:54 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:58:54 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:58:54 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:58:54 user nova-compute[73079]:   </os>
Aug 17 14:58:54 user nova-compute[73079]:   <features>
Aug 17 14:58:54 user nova-compute[73079]:     <acpi/>
Aug 17 14:58:54 user nova-compute[73079]:     <apic/>
Aug 17 14:58:54 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:58:54 user nova-compute[73079]:   </features>
Aug 17 14:58:54 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:58:54 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:58:54 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:58:54 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:58:54 user nova-compute[73079]:   </clock>
Aug 17 14:58:54 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:58:54 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:58:54 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:58:54 user nova-compute[73079]:   </cpu>
Aug 17 14:58:54 user nova-compute[73079]:   <devices>
Aug 17 14:58:54 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:58:54 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:58:54 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk"/>
Aug 17 14:58:54 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:58:54 user nova-compute[73079]:     </disk>
Aug 17 14:58:54 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:58:54 user nova-compute[73079]:       <mac address="fa:16:3e:f6:8f:d9"/>
Aug 17 14:58:54 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:58:54 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:58:54 user nova-compute[73079]:       <target dev="tapccb63dda-1c"/>
Aug 17 14:58:54 user nova-compute[73079]:     </interface>
Aug 17 14:58:54 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:58:54 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/console.log" append="off"/>
Aug 17 14:58:54 user nova-compute[73079]:     </serial>
Aug 17 14:58:54 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:58:54 user nova-compute[73079]:     <video>
Aug 17 14:58:54 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:58:54 user nova-compute[73079]:     </video>
Aug 17 14:58:54 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:58:54 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:58:54 user nova-compute[73079]:     </rng>
Aug 17 14:58:54 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:58:54 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:58:54 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:58:54 user nova-compute[73079]:     </memballoon>
Aug 17 14:58:54 user nova-compute[73079]:   </devices>
Aug 17 14:58:54 user nova-compute[73079]: </domain>
Aug 17 14:58:54 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1300453686',display_name='tempest-VolumesActionsTest-instance-1300453686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1300453686',id=33,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0ea26ddbec745688fc8d2b4e64f6189',ramdisk_id='',reservation_id='r-pb0y784c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1721904385',owner_user_name='tempest-VolumesActionsTest-1721904385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:58:52Z,user_data=None,user_id='8aacbb819abc4ff080673f4a1a1314f7',uuid=798284c1-c697-4048-a9e6-382efa5ee684,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Converting VIF {"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG os_vif [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccb63dda-1c, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccb63dda-1c, col_values=(('external_ids', {'iface-id': 'ccb63dda-1ca2-4601-bcc6-414c7bf1acdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:8f:d9', 'vm-uuid': '798284c1-c697-4048-a9e6-382efa5ee684'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:54 user nova-compute[73079]: INFO os_vif [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c')
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] No VIF found with MAC fa:16:3e:f6:8f:d9, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Updated VIF entry in instance network info cache for port ccb63dda-1ca2-4601-bcc6-414c7bf1acdb. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Updating instance_info_cache with network_info: [{"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:58:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd1708f0-1235-4d74-9f79-2d037ff87639 req-42836732-c2b2-41fa-82d5-1aed26dc8ac4 service nova] Releasing lock "refresh_cache-798284c1-c697-4048-a9e6-382efa5ee684" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-07ba7b2d-1c74-416b-938c-9ab3da29a6af req-fd6f7fec-0d36-4ed3-ad7c-a69b32032f04 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-07ba7b2d-1c74-416b-938c-9ab3da29a6af req-fd6f7fec-0d36-4ed3-ad7c-a69b32032f04 service nova] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-07ba7b2d-1c74-416b-938c-9ab3da29a6af req-fd6f7fec-0d36-4ed3-ad7c-a69b32032f04 service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-07ba7b2d-1c74-416b-938c-9ab3da29a6af req-fd6f7fec-0d36-4ed3-ad7c-a69b32032f04 service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-07ba7b2d-1c74-416b-938c-9ab3da29a6af req-fd6f7fec-0d36-4ed3-ad7c-a69b32032f04 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] No waiting events found dispatching network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:55 user nova-compute[73079]: WARNING nova.compute.manager [req-07ba7b2d-1c74-416b-938c-9ab3da29a6af req-fd6f7fec-0d36-4ed3-ad7c-a69b32032f04 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received unexpected event network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb for instance with vm_state building and task_state spawning.
Aug 17 14:58:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:56 user nova-compute[73079]: INFO nova.compute.manager [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Detaching volume f7cafec7-91af-400d-ba2a-81694571069e
Aug 17 14:58:56 user nova-compute[73079]: INFO nova.virt.block_device [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Attempting to driver detach volume f7cafec7-91af-400d-ba2a-81694571069e from mountpoint /dev/vdb
Aug 17 14:58:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Attempting to detach device vdb from instance 010c96fc-4eca-4af5-af52-412a3230c1df from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:58:56 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:58:56 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:58:56 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:58:56 user nova-compute[73079]:   <serial>f7cafec7-91af-400d-ba2a-81694571069e</serial>
Aug 17 14:58:56 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:58:56 user nova-compute[73079]: </disk>
Aug 17 14:58:56 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:58:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully detached device vdb from instance 010c96fc-4eca-4af5-af52-412a3230c1df from the persistent domain config.
Aug 17 14:58:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 010c96fc-4eca-4af5-af52-412a3230c1df from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:58:56 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:58:56 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 14:58:56 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:58:56 user nova-compute[73079]:   <serial>f7cafec7-91af-400d-ba2a-81694571069e</serial>
Aug 17 14:58:56 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:58:56 user nova-compute[73079]: </disk>
Aug 17 14:58:56 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:58:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284337.1457593, 010c96fc-4eca-4af5-af52-412a3230c1df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully detached device vdb from instance 010c96fc-4eca-4af5-af52-412a3230c1df from the live domain config.
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfwJcVTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:58:57 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[57506361-e1c6-40d5-8cb9-436ae02eac34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202fdee-51b5-4c4f-ada0-b8d1549ff790]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:57 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:57 user nova-compute[73079]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)
Aug 17 14:58:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:57 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:57 user nova-compute[73079]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e (non-flash)
Aug 17 14:58:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82fce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8df538-d4d7-4e37-afa3-02fc5106ccfc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7919f9-bdef-4ac5-ae0f-e8f32d68cc46]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e271a3-daa2-41cc-ac41-cc57846846d4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3260924-9da6-4b8b-84c0-896941779d9f]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bbdbe6-602f-4eac-bbb8-7561f89b2487]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c887e520-4e27-4520-afb3-3db3cdc12549]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260]
Aug 17 14:58:57 user nova-compute[73079]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e, portal: 172.16.0.220,3260] successful.
Aug 17 14:58:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55bbd5-08b0-4516-834e-c6e8474f1083]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== disconnect_volume: return (305ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-414f65eb-3f3d-424c-9883-7f81a797038a req-d19ec147-f13b-43cc-ae9b-0bce62b031bb service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-414f65eb-3f3d-424c-9883-7f81a797038a req-d19ec147-f13b-43cc-ae9b-0bce62b031bb service nova] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-414f65eb-3f3d-424c-9883-7f81a797038a req-d19ec147-f13b-43cc-ae9b-0bce62b031bb service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-414f65eb-3f3d-424c-9883-7f81a797038a req-d19ec147-f13b-43cc-ae9b-0bce62b031bb service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-414f65eb-3f3d-424c-9883-7f81a797038a req-d19ec147-f13b-43cc-ae9b-0bce62b031bb service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] No waiting events found dispatching network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:57 user nova-compute[73079]: WARNING nova.compute.manager [req-414f65eb-3f3d-424c-9883-7f81a797038a req-d19ec147-f13b-43cc-ae9b-0bce62b031bb service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received unexpected event network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb for instance with vm_state building and task_state spawning.
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284337.7735376, 798284c1-c697-4048-a9e6-382efa5ee684 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] VM Resumed (Lifecycle Event)
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Instance spawned successfully.
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284337.7748957, 798284c1-c697-4048-a9e6-382efa5ee684 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] VM Started (Lifecycle Event)
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 17 14:58:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:58:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:58:58 user nova-compute[73079]: INFO nova.compute.manager [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Took 6.52 seconds to build instance.
Aug 17 14:58:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6c5e4551-3484-4c71-8906-29a1a46e47a3 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "798284c1-c697-4048-a9e6-382efa5ee684" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.633s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'flavor' on Instance uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c71b3ad6-b9e5-4cfe-9d9a-e4dc451f0cf4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.819s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.698s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:58 user nova-compute[73079]: INFO nova.compute.manager [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Terminating instance
Aug 17 14:58:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:59 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Instance destroyed successfully.
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'resources' on Instance uuid 010c96fc-4eca-4af5-af52-412a3230c1df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-519654046',display_name='tempest-VolumesSnapshotTestJSON-instance-519654046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-519654046',id=30,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2kRH4kYbgSM2fxiwswyqrVONle9VZIFhryA9pmCET2afdBsMFvu2j4AqaMpeoLz9stHm4VOzzX2ITLa5rm53qLoVAK9Em2SQgBflwknjWy9d+VMokKPYKjsOFs6q4/sg==',key_name='tempest-keypair-1347503780',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44793ff31d0044ed921e6d2ab2f95e02',ramdisk_id='',reservation_id='r-l028krd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2084510521',owner_user_name='tempest-VolumesSnapshotTestJSON-2084510521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735852ace093495aaf816e6cad97d813',uuid=010c96fc-4eca-4af5-af52-412a3230c1df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converting VIF {"id": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "address": "fa:16:3e:3e:36:36", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431d9cb-a1", "ovs_interfaceid": "d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_vif [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd431d9cb-a1, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:58:59 user nova-compute[73079]: INFO os_vif [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:36:36,bridge_name='br-int',has_traffic_filtering=True,id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431d9cb-a1')
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfwJcVTy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:58:59 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7cafec7-91af-400d-ba2a-81694571069e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e400aa96-6bab-47c7-b866-8fbfb5806116]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92b2b43-8890-42fb-a781-05d6221b8f26]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:59 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:59 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:58:59 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:58:59 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c83e4ee0>, {}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Disconnecting from: [] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== disconnect_volume: return (49ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:58:59 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Deleting instance files /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df_del
Aug 17 14:58:59 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Deletion of /opt/stack/data/nova/instances/010c96fc-4eca-4af5-af52-412a3230c1df_del complete
Aug 17 14:58:59 user nova-compute[73079]: INFO nova.compute.manager [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-vif-unplugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] No waiting events found dispatching network-vif-unplugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-vif-unplugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] Acquiring lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] Lock "010c96fc-4eca-4af5-af52-412a3230c1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:58:59 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] No waiting events found dispatching network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:58:59 user nova-compute[73079]: WARNING nova.compute.manager [req-b5480dce-06e1-46db-b744-72e48c7069b0 req-2c6c6c09-e89c-4398-89f4-828442b2bc12 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received unexpected event network-vif-plugged-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 for instance with vm_state active and task_state deleting.
Aug 17 14:59:00 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:00 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Took 0.78 seconds to deallocate network for instance.
Aug 17 14:59:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-a616dff7-1c40-48c7-8a19-4022964f78b2 req-f3b04451-1601-46a9-8b81-d0c467c4ad26 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Received event network-vif-deleted-d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:00 user nova-compute[73079]: INFO nova.compute.manager [req-a616dff7-1c40-48c7-8a19-4022964f78b2 req-f3b04451-1601-46a9-8b81-d0c467c4ad26 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Neutron deleted interface d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2; detaching it from the instance and deleting it from the info cache
Aug 17 14:59:00 user nova-compute[73079]: DEBUG nova.network.neutron [req-a616dff7-1c40-48c7-8a19-4022964f78b2 req-f3b04451-1601-46a9-8b81-d0c467c4ad26 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:00 user nova-compute[73079]: WARNING nova.volume.cinder [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Attachment 29b460e5-6c69-4ca8-b52d-e14aa657b83e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 29b460e5-6c69-4ca8-b52d-e14aa657b83e. (HTTP 404) (Request-ID: req-8059bb4f-37b2-43bc-8797-29c388e4e3b1)
Aug 17 14:59:00 user nova-compute[73079]: INFO nova.compute.manager [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 14:59:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-a616dff7-1c40-48c7-8a19-4022964f78b2 req-f3b04451-1601-46a9-8b81-d0c467c4ad26 service nova] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Detach interface failed, port_id=d431d9cb-a15a-4c29-87bb-cdebfb4a4ec2, reason: Instance 010c96fc-4eca-4af5-af52-412a3230c1df could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:59:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:00 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:59:00 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:59:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:00 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Deleted allocations for instance 010c96fc-4eca-4af5-af52-412a3230c1df
Aug 17 14:59:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-048e4a30-8db6-4750-ace9-28872c4f9192 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "010c96fc-4eca-4af5-af52-412a3230c1df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.559s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:01 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284326.908831, 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:01 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] VM Stopped (Lifecycle Event)
Aug 17 14:59:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3192856f-1fb1-48c1-9c77-6f49b190ebac None None] [instance: 1e7950a1-4de8-43bc-a511-6e5d8c4b43e9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJmVcgay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:59:11 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:59:11 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:59:11 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e0ad18-33c0-40fd-a98a-802b22f2e2ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 14:59:11 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d76cfc2-4116-43bf-b456-b89c4739275d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689] added
Aug 17 14:59:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc7282-9521-4255-a64e-2f50b77ec2a8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbc5d2a-e92f-411a-8961-c0a3a22a2a3d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJmVcgay {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJmVcgay" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fb802e-57c4-4cf0-a792-526d3d5646dc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJmVcgay'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ed499-e08f-4cfd-aafd-ef1d2a744aa4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e85e5b0-6b6b-4020-9f27-7abea527fd0a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4008acb-f2e7-4064-8335-8d6d3f057840]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260]
Aug 17 14:59:11 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260] successful.
Aug 17 14:59:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a16b9c-78c3-450a-a1c2-a9fad25a7701]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98613e-2140-4534-827c-b73a10d2e0e7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 (non-flash)
Aug 17 14:59:11 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f7c42f-6112-4420-b6b0-da10caa2a28b]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:11 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJmVcgay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26332326261346265', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332326261346265', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 14:59:12 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:59:12 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:59:12 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:59:12 user nova-compute[73079]:   <serial>b8007e3d-cbe6-4b0c-9891-12801dffa689</serial>
Aug 17 14:59:12 user nova-compute[73079]: </disk>
Aug 17 14:59:12 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 14:59:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:59:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:59:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No VIF found with MAC fa:16:3e:ca:e5:50, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:59:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5849fb58-9ea4-43af-83f9-ba638e1a449a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.368s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 14:59:14 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284339.4380615, 010c96fc-4eca-4af5-af52-412a3230c1df => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:14 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] VM Stopped (Lifecycle Event)
Aug 17 14:59:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b2c1c5ca-2963-43ac-9d15-f3960bb88add None None] [instance: 010c96fc-4eca-4af5-af52-412a3230c1df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:15 user nova-compute[73079]: INFO nova.compute.manager [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Detaching volume b8007e3d-cbe6-4b0c-9891-12801dffa689
Aug 17 14:59:15 user nova-compute[73079]: INFO nova.virt.block_device [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attempting to driver detach volume b8007e3d-cbe6-4b0c-9891-12801dffa689 from mountpoint /dev/vdb
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Attempting to detach device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:59:15 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:59:15 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:59:15 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:59:15 user nova-compute[73079]:   <serial>b8007e3d-cbe6-4b0c-9891-12801dffa689</serial>
Aug 17 14:59:15 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:59:15 user nova-compute[73079]: </disk>
Aug 17 14:59:15 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:59:15 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config.
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 14:59:15 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 14:59:15 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 14:59:15 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 14:59:15 user nova-compute[73079]:   <serial>b8007e3d-cbe6-4b0c-9891-12801dffa689</serial>
Aug 17 14:59:15 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 14:59:15 user nova-compute[73079]: </disk>
Aug 17 14:59:15 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284355.971208, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 14:59:15 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config.
Aug 17 14:59:15 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJmVcgay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:59:15 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:59:15 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:59:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc985d86-f725-4791-aadc-c3aa84cd74fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f4bbab-369e-4386-a46d-eb8a871bac5b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:16 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:16 user nova-compute[73079]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 (non-flash)
Aug 17 14:59:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:16 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:16 user nova-compute[73079]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 (non-flash)
Aug 17 14:59:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e80915a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aebf5ed-7335-4984-8c50-c9f47d354adc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb624e2-103b-4a32-84dc-19ab130265fd]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f7a1d2-f96d-4903-8718-e29c0cd02706]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f34f8a8-7736-42ac-884c-2f69ab86a4e2]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcf3d0c-f0f4-4211-97ed-29df1ae28293]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[06074919-73cc-44c7-bdc0-50b05e72467d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260]
Aug 17 14:59:16 user nova-compute[73079]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689, portal: 172.16.0.220,3260] successful.
Aug 17 14:59:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8007e3d-cbe6-4b0c-9891-12801dffa689 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c662784-cc79-4646-b605-b5a8d37892e3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== disconnect_volume: return (285ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-aaa20f37-1cc0-43e0-9a7b-e7ed5bfba85b tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:59:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7949MB free_disk=25.315448760986328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 1115c466-99e9-408e-87c4-4fa6505d3eb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 798284c1-c697-4048-a9e6-382efa5ee684 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 14:59:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.317s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:59:20 user nova-compute[73079]: INFO nova.compute.claims [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Claim successful on node user
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:59:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.policy [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f67004af6654b5d80924a5c502a74f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd4ad5f2eb4e728a71908d32d353d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:59:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Creating image(s)
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "/opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk 1073741824" returned: 0 in 0.047s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Successfully created port: 051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.254s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Cannot resize image /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.objects.instance [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'migration_context' on Instance uuid 527647ad-d7ef-456f-a03b-3c2cd7572ce4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Ensure instance console log exists: /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating instance_info_cache with network_info: [{"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-1115c466-99e9-408e-87c4-4fa6505d3eb3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Successfully updated port: 051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-changed-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Refreshing instance network info cache due to event network-changed-051a4ec3-8620-482d-aa0f-99d3c44170cb. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] Acquiring lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:59:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updating instance_info_cache with network_info: [{"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Instance network_info: |[{"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] Acquired lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.neutron [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Refreshing network info cache for port 051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Start _get_guest_xml network_info=[{"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:59:23 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:59:23 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1179017841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1179017841',id=34,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-qz5stgv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:59:21Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=527647ad-d7ef-456f-a03b-3c2cd7572ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'pci_devices' on Instance uuid 527647ad-d7ef-456f-a03b-3c2cd7572ce4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:59:23 user nova-compute[73079]:   <uuid>527647ad-d7ef-456f-a03b-3c2cd7572ce4</uuid>
Aug 17 14:59:23 user nova-compute[73079]:   <name>instance-00000022</name>
Aug 17 14:59:23 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:59:23 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:59:23 user nova-compute[73079]:   <metadata>
Aug 17 14:59:23 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:59:23 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:59:23 user nova-compute[73079]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1179017841</nova:name>
Aug 17 14:59:23 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:59:23</nova:creationTime>
Aug 17 14:59:23 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:59:23 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:59:23 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:59:23 user nova-compute[73079]:       <nova:owner>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:user uuid="5f67004af6654b5d80924a5c502a74f2">tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member</nova:user>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:project uuid="0edd4ad5f2eb4e728a71908d32d353d5">tempest-ServerBootFromVolumeStableRescueTest-2072772980</nova:project>
Aug 17 14:59:23 user nova-compute[73079]:       </nova:owner>
Aug 17 14:59:23 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:59:23 user nova-compute[73079]:       <nova:ports>
Aug 17 14:59:23 user nova-compute[73079]:         <nova:port uuid="051a4ec3-8620-482d-aa0f-99d3c44170cb">
Aug 17 14:59:23 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 14:59:23 user nova-compute[73079]:         </nova:port>
Aug 17 14:59:23 user nova-compute[73079]:       </nova:ports>
Aug 17 14:59:23 user nova-compute[73079]:     </nova:instance>
Aug 17 14:59:23 user nova-compute[73079]:   </metadata>
Aug 17 14:59:23 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:59:23 user nova-compute[73079]:     <system>
Aug 17 14:59:23 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:59:23 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:59:23 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:59:23 user nova-compute[73079]:       <entry name="serial">527647ad-d7ef-456f-a03b-3c2cd7572ce4</entry>
Aug 17 14:59:23 user nova-compute[73079]:       <entry name="uuid">527647ad-d7ef-456f-a03b-3c2cd7572ce4</entry>
Aug 17 14:59:23 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:59:23 user nova-compute[73079]:     </system>
Aug 17 14:59:23 user nova-compute[73079]:   </sysinfo>
Aug 17 14:59:23 user nova-compute[73079]:   <os>
Aug 17 14:59:23 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:59:23 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:59:23 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:59:23 user nova-compute[73079]:   </os>
Aug 17 14:59:23 user nova-compute[73079]:   <features>
Aug 17 14:59:23 user nova-compute[73079]:     <acpi/>
Aug 17 14:59:23 user nova-compute[73079]:     <apic/>
Aug 17 14:59:23 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:59:23 user nova-compute[73079]:   </features>
Aug 17 14:59:23 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:59:23 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:59:23 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:59:23 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:59:23 user nova-compute[73079]:   </clock>
Aug 17 14:59:23 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:59:23 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:59:23 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:59:23 user nova-compute[73079]:   </cpu>
Aug 17 14:59:23 user nova-compute[73079]:   <devices>
Aug 17 14:59:23 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:59:23 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:59:23 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk"/>
Aug 17 14:59:23 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:59:23 user nova-compute[73079]:     </disk>
Aug 17 14:59:23 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:59:23 user nova-compute[73079]:       <mac address="fa:16:3e:1e:85:e8"/>
Aug 17 14:59:23 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:59:23 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:59:23 user nova-compute[73079]:       <target dev="tap051a4ec3-86"/>
Aug 17 14:59:23 user nova-compute[73079]:     </interface>
Aug 17 14:59:23 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:59:23 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/console.log" append="off"/>
Aug 17 14:59:23 user nova-compute[73079]:     </serial>
Aug 17 14:59:23 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:59:23 user nova-compute[73079]:     <video>
Aug 17 14:59:23 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:59:23 user nova-compute[73079]:     </video>
Aug 17 14:59:23 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:59:23 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:59:23 user nova-compute[73079]:     </rng>
Aug 17 14:59:23 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:59:23 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:59:23 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:59:23 user nova-compute[73079]:     </memballoon>
Aug 17 14:59:23 user nova-compute[73079]:   </devices>
Aug 17 14:59:23 user nova-compute[73079]: </domain>
Aug 17 14:59:23 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1179017841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1179017841',id=34,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-qz5stgv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:59:21Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=527647ad-d7ef-456f-a03b-3c2cd7572ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG os_vif [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap051a4ec3-86, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap051a4ec3-86, col_values=(('external_ids', {'iface-id': '051a4ec3-8620-482d-aa0f-99d3c44170cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:85:e8', 'vm-uuid': '527647ad-d7ef-456f-a03b-3c2cd7572ce4'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:23 user nova-compute[73079]: INFO os_vif [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86')
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No VIF found with MAC fa:16:3e:1e:85:e8, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.neutron [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updated VIF entry in instance network info cache for port 051a4ec3-8620-482d-aa0f-99d3c44170cb. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG nova.network.neutron [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updating instance_info_cache with network_info: [{"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f2eab040-c8d1-4b68-8aa6-465d4a19430b req-e4a1f368-5b91-41cd-ad47-ea2aefbbf3e5 service nova] Releasing lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-ef1dd580-eabf-4f9b-9dab-41033160b52c req-f792e35a-5c99-4d61-9960-ddc5e5f019e1 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ef1dd580-eabf-4f9b-9dab-41033160b52c req-f792e35a-5c99-4d61-9960-ddc5e5f019e1 service nova] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ef1dd580-eabf-4f9b-9dab-41033160b52c req-f792e35a-5c99-4d61-9960-ddc5e5f019e1 service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ef1dd580-eabf-4f9b-9dab-41033160b52c req-f792e35a-5c99-4d61-9960-ddc5e5f019e1 service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-ef1dd580-eabf-4f9b-9dab-41033160b52c req-f792e35a-5c99-4d61-9960-ddc5e5f019e1 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] No waiting events found dispatching network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:59:25 user nova-compute[73079]: WARNING nova.compute.manager [req-ef1dd580-eabf-4f9b-9dab-41033160b52c req-f792e35a-5c99-4d61-9960-ddc5e5f019e1 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received unexpected event network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb for instance with vm_state building and task_state spawning.
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 14:59:26 user nova-compute[73079]: INFO nova.compute.claims [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Claim successful on node user
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.network.neutron [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 14:59:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.policy [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7edb85ca3cd14d4587b951327e892bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ac38bd75ed4e588b516582286bfb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 14:59:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Creating image(s)
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "/opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "/opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.200s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk 1073741824" returned: 0 in 0.072s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284367.4216497, 527647ad-d7ef-456f-a03b-3c2cd7572ce4 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] VM Resumed (Lifecycle Event)
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Instance spawned successfully.
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284367.4252105, 527647ad-d7ef-456f-a03b-3c2cd7572ce4 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] VM Started (Lifecycle Event)
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-da7c3819-02d9-4251-ad5c-bac252080c22 req-e42b5aae-6a3c-4ef7-b0a8-012b3fd5fc5f service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-da7c3819-02d9-4251-ad5c-bac252080c22 req-e42b5aae-6a3c-4ef7-b0a8-012b3fd5fc5f service nova] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-da7c3819-02d9-4251-ad5c-bac252080c22 req-e42b5aae-6a3c-4ef7-b0a8-012b3fd5fc5f service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-da7c3819-02d9-4251-ad5c-bac252080c22 req-e42b5aae-6a3c-4ef7-b0a8-012b3fd5fc5f service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-da7c3819-02d9-4251-ad5c-bac252080c22 req-e42b5aae-6a3c-4ef7-b0a8-012b3fd5fc5f service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] No waiting events found dispatching network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:59:27 user nova-compute[73079]: WARNING nova.compute.manager [req-da7c3819-02d9-4251-ad5c-bac252080c22 req-e42b5aae-6a3c-4ef7-b0a8-012b3fd5fc5f service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received unexpected event network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb for instance with vm_state building and task_state spawning.
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Took 6.89 seconds to spawn the instance on the hypervisor.
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Successfully created port: 657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:59:27 user nova-compute[73079]: INFO nova.compute.manager [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Took 7.85 seconds to build instance.
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd9ef9ac-98a6-4d8c-8e2e-0e2eb9b84024 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.944s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Cannot resize image /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'migration_context' on Instance uuid 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Ensure instance console log exists: /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Successfully updated port: 657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquired lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-changed-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Refreshing instance network info cache due to event network-changed-657f7df0-44a2-48e6-8e99-45c31bd06427. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] Acquiring lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updating instance_info_cache with network_info: [{"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Releasing lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Instance network_info: |[{"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] Acquired lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.neutron [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Refreshing network info cache for port 657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Start _get_guest_xml network_info=[{"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 14:59:28 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:59:28 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1800947916',display_name='tempest-AttachVolumeNegativeTest-server-1800947916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1800947916',id=35,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu2mzKKTyMBNh8w7sGN821nSlIaRnL3nM6NyX9xpMsqiB67tEben8Vm9lQnT9hI637WL6p9ZHNCkk3RIpKFGDEkCwJs85wHdhDcnrXDiDJeP97rWZZSj0nw6H9mTZqKCA==',key_name='tempest-keypair-1965297056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-wgz8t704',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=7052d5fa-bc72-4f78-bd9d-0bcc29432ec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:59:28 user nova-compute[73079]: DEBUG nova.objects.instance [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'pci_devices' on Instance uuid 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 14:59:29 user nova-compute[73079]:   <uuid>7052d5fa-bc72-4f78-bd9d-0bcc29432ec5</uuid>
Aug 17 14:59:29 user nova-compute[73079]:   <name>instance-00000023</name>
Aug 17 14:59:29 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 14:59:29 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 14:59:29 user nova-compute[73079]:   <metadata>
Aug 17 14:59:29 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 14:59:29 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 14:59:29 user nova-compute[73079]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1800947916</nova:name>
Aug 17 14:59:29 user nova-compute[73079]:       <nova:creationTime>2023-08-17 14:59:28</nova:creationTime>
Aug 17 14:59:29 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 14:59:29 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 14:59:29 user nova-compute[73079]:       </nova:flavor>
Aug 17 14:59:29 user nova-compute[73079]:       <nova:owner>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:user uuid="7edb85ca3cd14d4587b951327e892bd6">tempest-AttachVolumeNegativeTest-706656920-project-member</nova:user>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:project uuid="04ac38bd75ed4e588b516582286bfb97">tempest-AttachVolumeNegativeTest-706656920</nova:project>
Aug 17 14:59:29 user nova-compute[73079]:       </nova:owner>
Aug 17 14:59:29 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 14:59:29 user nova-compute[73079]:       <nova:ports>
Aug 17 14:59:29 user nova-compute[73079]:         <nova:port uuid="657f7df0-44a2-48e6-8e99-45c31bd06427">
Aug 17 14:59:29 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 14:59:29 user nova-compute[73079]:         </nova:port>
Aug 17 14:59:29 user nova-compute[73079]:       </nova:ports>
Aug 17 14:59:29 user nova-compute[73079]:     </nova:instance>
Aug 17 14:59:29 user nova-compute[73079]:   </metadata>
Aug 17 14:59:29 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 14:59:29 user nova-compute[73079]:     <system>
Aug 17 14:59:29 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 14:59:29 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 14:59:29 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 14:59:29 user nova-compute[73079]:       <entry name="serial">7052d5fa-bc72-4f78-bd9d-0bcc29432ec5</entry>
Aug 17 14:59:29 user nova-compute[73079]:       <entry name="uuid">7052d5fa-bc72-4f78-bd9d-0bcc29432ec5</entry>
Aug 17 14:59:29 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 14:59:29 user nova-compute[73079]:     </system>
Aug 17 14:59:29 user nova-compute[73079]:   </sysinfo>
Aug 17 14:59:29 user nova-compute[73079]:   <os>
Aug 17 14:59:29 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 14:59:29 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 14:59:29 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 14:59:29 user nova-compute[73079]:   </os>
Aug 17 14:59:29 user nova-compute[73079]:   <features>
Aug 17 14:59:29 user nova-compute[73079]:     <acpi/>
Aug 17 14:59:29 user nova-compute[73079]:     <apic/>
Aug 17 14:59:29 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 14:59:29 user nova-compute[73079]:   </features>
Aug 17 14:59:29 user nova-compute[73079]:   <clock offset="utc">
Aug 17 14:59:29 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 14:59:29 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 14:59:29 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 14:59:29 user nova-compute[73079]:   </clock>
Aug 17 14:59:29 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 14:59:29 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 14:59:29 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 14:59:29 user nova-compute[73079]:   </cpu>
Aug 17 14:59:29 user nova-compute[73079]:   <devices>
Aug 17 14:59:29 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 14:59:29 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 14:59:29 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk"/>
Aug 17 14:59:29 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 14:59:29 user nova-compute[73079]:     </disk>
Aug 17 14:59:29 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 14:59:29 user nova-compute[73079]:       <mac address="fa:16:3e:a2:7a:0b"/>
Aug 17 14:59:29 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:59:29 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 14:59:29 user nova-compute[73079]:       <target dev="tap657f7df0-44"/>
Aug 17 14:59:29 user nova-compute[73079]:     </interface>
Aug 17 14:59:29 user nova-compute[73079]:     <serial type="pty">
Aug 17 14:59:29 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/console.log" append="off"/>
Aug 17 14:59:29 user nova-compute[73079]:     </serial>
Aug 17 14:59:29 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 14:59:29 user nova-compute[73079]:     <video>
Aug 17 14:59:29 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 14:59:29 user nova-compute[73079]:     </video>
Aug 17 14:59:29 user nova-compute[73079]:     <rng model="virtio">
Aug 17 14:59:29 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 14:59:29 user nova-compute[73079]:     </rng>
Aug 17 14:59:29 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 14:59:29 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 14:59:29 user nova-compute[73079]:       <stats period="10"/>
Aug 17 14:59:29 user nova-compute[73079]:     </memballoon>
Aug 17 14:59:29 user nova-compute[73079]:   </devices>
Aug 17 14:59:29 user nova-compute[73079]: </domain>
Aug 17 14:59:29 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1800947916',display_name='tempest-AttachVolumeNegativeTest-server-1800947916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1800947916',id=35,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu2mzKKTyMBNh8w7sGN821nSlIaRnL3nM6NyX9xpMsqiB67tEben8Vm9lQnT9hI637WL6p9ZHNCkk3RIpKFGDEkCwJs85wHdhDcnrXDiDJeP97rWZZSj0nw6H9mTZqKCA==',key_name='tempest-keypair-1965297056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-wgz8t704',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T14:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=7052d5fa-bc72-4f78-bd9d-0bcc29432ec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG os_vif [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap657f7df0-44, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap657f7df0-44, col_values=(('external_ids', {'iface-id': '657f7df0-44a2-48e6-8e99-45c31bd06427', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:7a:0b', 'vm-uuid': '7052d5fa-bc72-4f78-bd9d-0bcc29432ec5'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:29 user nova-compute[73079]: INFO os_vif [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44')
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:a2:7a:0b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.network.neutron [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updated VIF entry in instance network info cache for port 657f7df0-44a2-48e6-8e99-45c31bd06427. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG nova.network.neutron [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updating instance_info_cache with network_info: [{"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5f1265cf-08a5-46d5-85ab-e62b879a3bfb req-edaf860f-6e3a-4946-bca6-1ab740f05641 service nova] Releasing lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-6228dedb-d4b6-41a5-882b-07500ddfe986 req-9b8c83c0-8ca9-4b7b-879f-cbcae2f14aea service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6228dedb-d4b6-41a5-882b-07500ddfe986 req-9b8c83c0-8ca9-4b7b-879f-cbcae2f14aea service nova] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6228dedb-d4b6-41a5-882b-07500ddfe986 req-9b8c83c0-8ca9-4b7b-879f-cbcae2f14aea service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6228dedb-d4b6-41a5-882b-07500ddfe986 req-9b8c83c0-8ca9-4b7b-879f-cbcae2f14aea service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-6228dedb-d4b6-41a5-882b-07500ddfe986 req-9b8c83c0-8ca9-4b7b-879f-cbcae2f14aea service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] No waiting events found dispatching network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:59:30 user nova-compute[73079]: WARNING nova.compute.manager [req-6228dedb-d4b6-41a5-882b-07500ddfe986 req-9b8c83c0-8ca9-4b7b-879f-cbcae2f14aea service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received unexpected event network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 for instance with vm_state building and task_state spawning.
Aug 17 14:59:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284372.620315, 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] VM Resumed (Lifecycle Event)
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Instance spawned successfully.
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284372.6245782, 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] VM Started (Lifecycle Event)
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e525d4-6874-44db-9622-ee02ae828cfd req-975bf6c6-42da-4122-a5cd-883bb969467f service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e525d4-6874-44db-9622-ee02ae828cfd req-975bf6c6-42da-4122-a5cd-883bb969467f service nova] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e525d4-6874-44db-9622-ee02ae828cfd req-975bf6c6-42da-4122-a5cd-883bb969467f service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52e525d4-6874-44db-9622-ee02ae828cfd req-975bf6c6-42da-4122-a5cd-883bb969467f service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-52e525d4-6874-44db-9622-ee02ae828cfd req-975bf6c6-42da-4122-a5cd-883bb969467f service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] No waiting events found dispatching network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:59:32 user nova-compute[73079]: WARNING nova.compute.manager [req-52e525d4-6874-44db-9622-ee02ae828cfd req-975bf6c6-42da-4122-a5cd-883bb969467f service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received unexpected event network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 for instance with vm_state building and task_state spawning.
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 17 14:59:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 14:59:32 user nova-compute[73079]: INFO nova.compute.manager [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Took 6.67 seconds to build instance.
Aug 17 14:59:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-733b6785-0b13-4f64-8d52-5c25e07353fd tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:44 user nova-compute[73079]: INFO nova.compute.manager [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Terminating instance
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-0d39aff3-c1fc-4d98-a9f6-1e4422c796aa req-dceecb40-d32e-4b8f-be7d-07f62d8e8492 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-vif-unplugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0d39aff3-c1fc-4d98-a9f6-1e4422c796aa req-dceecb40-d32e-4b8f-be7d-07f62d8e8492 service nova] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0d39aff3-c1fc-4d98-a9f6-1e4422c796aa req-dceecb40-d32e-4b8f-be7d-07f62d8e8492 service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0d39aff3-c1fc-4d98-a9f6-1e4422c796aa req-dceecb40-d32e-4b8f-be7d-07f62d8e8492 service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-0d39aff3-c1fc-4d98-a9f6-1e4422c796aa req-dceecb40-d32e-4b8f-be7d-07f62d8e8492 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] No waiting events found dispatching network-vif-unplugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-0d39aff3-c1fc-4d98-a9f6-1e4422c796aa req-dceecb40-d32e-4b8f-be7d-07f62d8e8492 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-vif-unplugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 14:59:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Instance destroyed successfully.
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'resources' on Instance uuid 1115c466-99e9-408e-87c4-4fa6505d3eb3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1881575607',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1881575607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1881575607',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIlIEkPOe6KNCvBnzb+i8c/HUsoVzKJ3cmt24qtRU34xBBVyb1jrN4b9Qol1GZzR9REHW0g/Zur7bbc26+phvIc3qJqWOHTw/LXF31Sj3szV8PUPCuG5HQocp/sp3nZvg==',key_name='tempest-keypair-1853360758',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:55:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-giccfphp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='722f38129c96487b8331cde0ab317832',uuid=1115c466-99e9-408e-87c4-4fa6505d3eb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "address": "fa:16:3e:d1:73:0b", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a1697f4-98", "ovs_interfaceid": "2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 14:59:44 user nova-compute[73079]: DEBUG os_vif [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a1697f4-98, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 14:59:45 user nova-compute[73079]: INFO os_vif [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:73:0b,bridge_name='br-int',has_traffic_filtering=True,id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a1697f4-98')
Aug 17 14:59:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySwAeLXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 14:59:45 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f0aae-1c72-4457-acbc-e837b521b6e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b0dd69-9bf3-4def-821d-403bb60ae888]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:45 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 14:59:45 user nova-compute[73079]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 (non-flash)
Aug 17 14:59:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c8407400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172'): ({'sdf'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Removing single pathed devices sdf {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[50200a79-1876-4c0b-b71e-257643859ca6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6861a72-ea1d-4615-9e60-a20212b1697c]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flushing IO for device /dev/sdf {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f95a1-78ae-4ec4-8223-1c29019c87a9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bdb86a-19d5-406a-a918-5ef74c2f1127]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] SCSI volumes sdf have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2c9f935-e388c58b0b1bd7a7', '/dev/disk/by-id/scsi-26533383863353862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c9f935') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f11c04d-a6de-4a40-bccd-a51b17ab9756]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f3464f-7156-4c6c-86f7-6a7ff2a29d6e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf75855-b67e-42be-b0c6-8c338aebca4c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260]
Aug 17 14:59:45 user nova-compute[73079]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172, portal: 172.16.0.220,3260] successful.
Aug 17 14:59:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e51176-276b-4225-8eec-e14ba0939172 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7b710-1742-4590-8a45-59b601a886ea]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== disconnect_volume: return (287ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 14:59:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Deleting instance files /opt/stack/data/nova/instances/1115c466-99e9-408e-87c4-4fa6505d3eb3_del
Aug 17 14:59:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Deletion of /opt/stack/data/nova/instances/1115c466-99e9-408e-87c4-4fa6505d3eb3_del complete
Aug 17 14:59:45 user nova-compute[73079]: INFO nova.compute.manager [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 17 14:59:45 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 14:59:45 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-b7d09fdb-9e57-42d6-a092-efa350d2ab04 req-99d5a5c0-0e2a-4bb9-8c97-82a81c6a9b93 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-vif-deleted-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:46 user nova-compute[73079]: INFO nova.compute.manager [req-b7d09fdb-9e57-42d6-a092-efa350d2ab04 req-99d5a5c0-0e2a-4bb9-8c97-82a81c6a9b93 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Neutron deleted interface 2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc; detaching it from the instance and deleting it from the info cache
Aug 17 14:59:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-b7d09fdb-9e57-42d6-a092-efa350d2ab04 req-99d5a5c0-0e2a-4bb9-8c97-82a81c6a9b93 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:46 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Took 0.85 seconds to deallocate network for instance.
Aug 17 14:59:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-b7d09fdb-9e57-42d6-a092-efa350d2ab04 req-99d5a5c0-0e2a-4bb9-8c97-82a81c6a9b93 service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Detach interface failed, port_id=2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc, reason: Instance 1115c466-99e9-408e-87c4-4fa6505d3eb3 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-77e9b02c-6991-4bda-a5f5-7eaa26925868 req-8d448439-d070-40a5-90d1-073359179eca service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received event network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-77e9b02c-6991-4bda-a5f5-7eaa26925868 req-8d448439-d070-40a5-90d1-073359179eca service nova] Acquiring lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-77e9b02c-6991-4bda-a5f5-7eaa26925868 req-8d448439-d070-40a5-90d1-073359179eca service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-77e9b02c-6991-4bda-a5f5-7eaa26925868 req-8d448439-d070-40a5-90d1-073359179eca service nova] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-77e9b02c-6991-4bda-a5f5-7eaa26925868 req-8d448439-d070-40a5-90d1-073359179eca service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] No waiting events found dispatching network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 14:59:46 user nova-compute[73079]: WARNING nova.compute.manager [req-77e9b02c-6991-4bda-a5f5-7eaa26925868 req-8d448439-d070-40a5-90d1-073359179eca service nova] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Received unexpected event network-vif-plugged-2a1697f4-98f0-4221-a0bb-56c7b6b6a9dc for instance with vm_state active and task_state deleting.
Aug 17 14:59:47 user nova-compute[73079]: INFO nova.compute.manager [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 14:59:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Deleting volume: 11e51176-276b-4225-8eec-e14ba0939172 {{(pid=73079) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 14:59:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 14:59:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 14:59:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:47 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 14:59:47 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 14:59:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:47 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Deleted allocations for instance 1115c466-99e9-408e-87c4-4fa6505d3eb3
Aug 17 14:59:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f483889d-7a9b-47ab-ad2d-a87332dfb040 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "1115c466-99e9-408e-87c4-4fa6505d3eb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.374s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 14:59:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-changed-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 14:59:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Refreshing instance network info cache due to event network-changed-bae76952-ee78-41c5-8587-39aa52f950f4. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 14:59:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 14:59:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 14:59:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Refreshing network info cache for port bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 14:59:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated VIF entry in instance network info cache for port bae76952-ee78-41c5-8587-39aa52f950f4. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 14:59:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 14:59:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ebac5e7-b8f3-4284-8a5e-3d0142fd2d81 req-285f4f27-c5f1-4f1b-b621-d1f35e460a8f service nova] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 14:59:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 14:59:59 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284384.955746, 1115c466-99e9-408e-87c4-4fa6505d3eb3 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 14:59:59 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] VM Stopped (Lifecycle Event)
Aug 17 14:59:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6e5fecf3-6e53-403a-8fce-8646bdcb61d4 None None] [instance: 1115c466-99e9-408e-87c4-4fa6505d3eb3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:00:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:09 user nova-compute[73079]: INFO nova.compute.manager [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attaching volume 11bcd6f0-466d-459b-8af6-bebc2af8a1d2 to /dev/vdb
Aug 17 15:00:09 user nova-compute[73079]: DEBUG os_brick.utils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aa4ee0-f0cb-4be7-8db9-604a1f3e2bd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[388647de-a07e-4e41-9d50-48f2926b4539]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f810aa-1642-477f-9c43-09b575f4d83a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d7cf1-a59b-4352-9a8b-a73db4c96e74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:00:09 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:00:10 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2c260-5b15-40c1-a02e-b97a733a2261]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:00:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:00:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:00:10 user nova-compute[73079]: DEBUG os_brick.utils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:00:10 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating existing volume attachment record: 00eab33f-8929-4f75-ba7e-ef32eb6adbbb {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:00:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:00:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FunLBdWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:00:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:00:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:00:20 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:00:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7902MB free_disk=25.253578186035156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5208cc0-126d-4e35-8294-8f580df97ef9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:00:20 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d1fbe8-c27c-4413-9cdb-c457a23c1335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2] added
Aug 17 15:00:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0e802-3186-4e45-844c-be359e69c0a5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[974cec4b-e13a-46b0-ac9e-47dcd4b9c0df]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FunLBdWs {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FunLBdWs" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[803265a0-8e37-4e99-b946-9d182b2ccbcd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FunLBdWs'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 798284c1-c697-4048-a9e6-382efa5ee684 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[039f50a8-12d4-4159-ab23-f927171a11c9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d929551e-2f02-4d45-84cb-28e48ff0bdc5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:00:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:00:20 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:00:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca08e52-0baa-45ca-87d2-f849d0a902b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260]
Aug 17 15:00:21 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260] successful.
Aug 17 15:00:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd4c85-8318-42e8-be66-229b8ac42c16]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15f1365-df37-4ab5-9165-9a385172e778]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:00:21 user nova-compute[73079]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 (non-flash)
Aug 17 15:00:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:00:21 user nova-compute[73079]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 (non-flash)
Aug 17 15:00:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.571s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a222b70-704a-4c7c-b6d0-2db946728e93]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FunLBdWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.195s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:00:21 user nova-compute[73079]: INFO nova.compute.claims [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Claim successful on node user
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:00:21 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.policy [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '735852ace093495aaf816e6cad97d813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44793ff31d0044ed921e6d2ab2f95e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:00:21 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Creating image(s)
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "/opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "/opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.613s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== connect_volume: return (1618ms) {'type': 'block', 'scsi_wwn': '26533313536626333', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533313536626333', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:00:22 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:00:22 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 15:00:22 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:00:22 user nova-compute[73079]:   <serial>11bcd6f0-466d-459b-8af6-bebc2af8a1d2</serial>
Aug 17 15:00:22 user nova-compute[73079]: </disk>
Aug 17 15:00:22 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Skipping network cache update for instance because it is Building. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk 1073741824" returned: 0 in 0.208s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] No VIF found with MAC fa:16:3e:ca:e5:50, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Successfully created port: dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.239s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-06a25d34-9280-434b-a42d-c53a6005b31f tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.106s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Cannot resize image /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'migration_context' on Instance uuid 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Ensure instance console log exists: /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Successfully updated port: dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquired lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-changed-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Refreshing instance network info cache due to event network-changed-dd037561-804d-4905-a498-dc89d81555f3. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] Acquiring lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:00:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.neutron [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updating instance_info_cache with network_info: [{"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Releasing lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Instance network_info: |[{"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] Acquired lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Refreshing network info cache for port dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Start _get_guest_xml network_info=[{"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:00:24 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:00:24 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1160679597',display_name='tempest-VolumesSnapshotTestJSON-instance-1160679597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1160679597',id=36,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQXzy6Ow/EpSeuygFukkrZwp6P1s/99kO2ISGikaqcvIShDj7749ZeH20YEkjyXFmlGZUGo+Oj95kHRji6BwbfRcYsG+k90JRjNkvESU9UY9OlYR/KoSaNS+uCKJc7c/w==',key_name='tempest-keypair-154458942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44793ff31d0044ed921e6d2ab2f95e02',ramdisk_id='',reservation_id='r-pmaugcbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2084510521',owner_user_name='tempest-VolumesSnapshotTestJSON-2084510521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735852ace093495aaf816e6cad97d813',uuid=5c0eb7ca-8ef7-4193-8cf9-d051dceebae7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converting VIF {"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.objects.instance [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:00:24 user nova-compute[73079]:   <uuid>5c0eb7ca-8ef7-4193-8cf9-d051dceebae7</uuid>
Aug 17 15:00:24 user nova-compute[73079]:   <name>instance-00000024</name>
Aug 17 15:00:24 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:00:24 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:00:24 user nova-compute[73079]:   <metadata>
Aug 17 15:00:24 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:00:24 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:00:24 user nova-compute[73079]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1160679597</nova:name>
Aug 17 15:00:24 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:00:24</nova:creationTime>
Aug 17 15:00:24 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:00:24 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:00:24 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:00:24 user nova-compute[73079]:       <nova:owner>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:user uuid="735852ace093495aaf816e6cad97d813">tempest-VolumesSnapshotTestJSON-2084510521-project-member</nova:user>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:project uuid="44793ff31d0044ed921e6d2ab2f95e02">tempest-VolumesSnapshotTestJSON-2084510521</nova:project>
Aug 17 15:00:24 user nova-compute[73079]:       </nova:owner>
Aug 17 15:00:24 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:00:24 user nova-compute[73079]:       <nova:ports>
Aug 17 15:00:24 user nova-compute[73079]:         <nova:port uuid="dd037561-804d-4905-a498-dc89d81555f3">
Aug 17 15:00:24 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 15:00:24 user nova-compute[73079]:         </nova:port>
Aug 17 15:00:24 user nova-compute[73079]:       </nova:ports>
Aug 17 15:00:24 user nova-compute[73079]:     </nova:instance>
Aug 17 15:00:24 user nova-compute[73079]:   </metadata>
Aug 17 15:00:24 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:00:24 user nova-compute[73079]:     <system>
Aug 17 15:00:24 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:00:24 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:00:24 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:00:24 user nova-compute[73079]:       <entry name="serial">5c0eb7ca-8ef7-4193-8cf9-d051dceebae7</entry>
Aug 17 15:00:24 user nova-compute[73079]:       <entry name="uuid">5c0eb7ca-8ef7-4193-8cf9-d051dceebae7</entry>
Aug 17 15:00:24 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:00:24 user nova-compute[73079]:     </system>
Aug 17 15:00:24 user nova-compute[73079]:   </sysinfo>
Aug 17 15:00:24 user nova-compute[73079]:   <os>
Aug 17 15:00:24 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:00:24 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:00:24 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:00:24 user nova-compute[73079]:   </os>
Aug 17 15:00:24 user nova-compute[73079]:   <features>
Aug 17 15:00:24 user nova-compute[73079]:     <acpi/>
Aug 17 15:00:24 user nova-compute[73079]:     <apic/>
Aug 17 15:00:24 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:00:24 user nova-compute[73079]:   </features>
Aug 17 15:00:24 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:00:24 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:00:24 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:00:24 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:00:24 user nova-compute[73079]:   </clock>
Aug 17 15:00:24 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:00:24 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:00:24 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:00:24 user nova-compute[73079]:   </cpu>
Aug 17 15:00:24 user nova-compute[73079]:   <devices>
Aug 17 15:00:24 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:00:24 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:00:24 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk"/>
Aug 17 15:00:24 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:00:24 user nova-compute[73079]:     </disk>
Aug 17 15:00:24 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:00:24 user nova-compute[73079]:       <mac address="fa:16:3e:e1:f2:64"/>
Aug 17 15:00:24 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:00:24 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:00:24 user nova-compute[73079]:       <target dev="tapdd037561-80"/>
Aug 17 15:00:24 user nova-compute[73079]:     </interface>
Aug 17 15:00:24 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:00:24 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/console.log" append="off"/>
Aug 17 15:00:24 user nova-compute[73079]:     </serial>
Aug 17 15:00:24 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:00:24 user nova-compute[73079]:     <video>
Aug 17 15:00:24 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:00:24 user nova-compute[73079]:     </video>
Aug 17 15:00:24 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:00:24 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:00:24 user nova-compute[73079]:     </rng>
Aug 17 15:00:24 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:00:24 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:00:24 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:00:24 user nova-compute[73079]:     </memballoon>
Aug 17 15:00:24 user nova-compute[73079]:   </devices>
Aug 17 15:00:24 user nova-compute[73079]: </domain>
Aug 17 15:00:24 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1160679597',display_name='tempest-VolumesSnapshotTestJSON-instance-1160679597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1160679597',id=36,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQXzy6Ow/EpSeuygFukkrZwp6P1s/99kO2ISGikaqcvIShDj7749ZeH20YEkjyXFmlGZUGo+Oj95kHRji6BwbfRcYsG+k90JRjNkvESU9UY9OlYR/KoSaNS+uCKJc7c/w==',key_name='tempest-keypair-154458942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44793ff31d0044ed921e6d2ab2f95e02',ramdisk_id='',reservation_id='r-pmaugcbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2084510521',owner_user_name='tempest-VolumesSnapshotTestJSON-2084510521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735852ace093495aaf816e6cad97d813',uuid=5c0eb7ca-8ef7-4193-8cf9-d051dceebae7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converting VIF {"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG os_vif [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd037561-80, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd037561-80, col_values=(('external_ids', {'iface-id': 'dd037561-804d-4905-a498-dc89d81555f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f2:64', 'vm-uuid': '5c0eb7ca-8ef7-4193-8cf9-d051dceebae7'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:24 user nova-compute[73079]: INFO os_vif [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80')
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No VIF found with MAC fa:16:3e:e1:f2:64, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updated VIF entry in instance network info cache for port dd037561-804d-4905-a498-dc89d81555f3. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updating instance_info_cache with network_info: [{"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:00:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ec0cd8e-942f-44a2-adf3-b0c78c57b319 req-4b0ac878-a63e-4433-a158-26f890df5151 service nova] Releasing lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:25 user nova-compute[73079]: INFO nova.compute.manager [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Detaching volume 11bcd6f0-466d-459b-8af6-bebc2af8a1d2
Aug 17 15:00:25 user nova-compute[73079]: INFO nova.virt.block_device [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Attempting to driver detach volume 11bcd6f0-466d-459b-8af6-bebc2af8a1d2 from mountpoint /dev/vdb
Aug 17 15:00:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Attempting to detach device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:00:25 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:00:25 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 15:00:25 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:00:25 user nova-compute[73079]:   <serial>11bcd6f0-466d-459b-8af6-bebc2af8a1d2</serial>
Aug 17 15:00:25 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:00:25 user nova-compute[73079]: </disk>
Aug 17 15:00:25 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:00:25 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the persistent domain config.
Aug 17 15:00:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:00:25 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:00:25 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 15:00:25 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:00:25 user nova-compute[73079]:   <serial>11bcd6f0-466d-459b-8af6-bebc2af8a1d2</serial>
Aug 17 15:00:25 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:00:25 user nova-compute[73079]: </disk>
Aug 17 15:00:25 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-6a8f6ded-5d13-427a-a780-088519b37749 req-1785a2cc-48d1-4496-bee3-559b58df2f80 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6a8f6ded-5d13-427a-a780-088519b37749 req-1785a2cc-48d1-4496-bee3-559b58df2f80 service nova] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6a8f6ded-5d13-427a-a780-088519b37749 req-1785a2cc-48d1-4496-bee3-559b58df2f80 service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6a8f6ded-5d13-427a-a780-088519b37749 req-1785a2cc-48d1-4496-bee3-559b58df2f80 service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-6a8f6ded-5d13-427a-a780-088519b37749 req-1785a2cc-48d1-4496-bee3-559b58df2f80 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] No waiting events found dispatching network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:00:25 user nova-compute[73079]: WARNING nova.compute.manager [req-6a8f6ded-5d13-427a-a780-088519b37749 req-1785a2cc-48d1-4496-bee3-559b58df2f80 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received unexpected event network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 for instance with vm_state building and task_state spawning.
Aug 17 15:00:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284426.2093441, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:00:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully detached device vdb from instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 from the live domain config.
Aug 17 15:00:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FunLBdWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:00:26 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed25dc-ed8c-4b2b-8f8d-449214523613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82208962-6e15-405a-8c2e-46910d3fa116]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:00:26 user nova-compute[73079]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 (non-flash)
Aug 17 15:00:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:00:26 user nova-compute[73079]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 (non-flash)
Aug 17 15:00:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f796f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[beed0b7b-bae3-4da9-bbbe-ba60deebd4b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc91905-209b-40d7-851b-106a9f891d0b]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa425d-b71a-4baf-b47e-2d9cfd762ab5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[af76c23d-307c-42bc-aed5-ec5472307205]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6020f3c7-92f3-4e51-8bc9-8c1f37f3ece5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42731ef-e17f-4fdf-99aa-0b2b4bc0b8ff]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260]
Aug 17 15:00:26 user nova-compute[73079]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2, portal: 172.16.0.220,3260] successful.
Aug 17 15:00:26 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11bcd6f0-466d-459b-8af6-bebc2af8a1d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e21d7e6-f53a-4ea6-b3b8-2e3802c08ac4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] <== disconnect_volume: return (281ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:00:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'flavor' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4ffcd661-bcb8-437d-a595-9686a8894abe tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-52c9c767-06e6-4002-8084-308a4590a6cd req-72ad36b3-ae75-4c44-bc49-924055c2097b service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52c9c767-06e6-4002-8084-308a4590a6cd req-72ad36b3-ae75-4c44-bc49-924055c2097b service nova] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52c9c767-06e6-4002-8084-308a4590a6cd req-72ad36b3-ae75-4c44-bc49-924055c2097b service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-52c9c767-06e6-4002-8084-308a4590a6cd req-72ad36b3-ae75-4c44-bc49-924055c2097b service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:27 user nova-compute[73079]: DEBUG nova.compute.manager [req-52c9c767-06e6-4002-8084-308a4590a6cd req-72ad36b3-ae75-4c44-bc49-924055c2097b service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] No waiting events found dispatching network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:00:27 user nova-compute[73079]: WARNING nova.compute.manager [req-52c9c767-06e6-4002-8084-308a4590a6cd req-72ad36b3-ae75-4c44-bc49-924055c2097b service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received unexpected event network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 for instance with vm_state building and task_state spawning.
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284428.003976, 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] VM Resumed (Lifecycle Event)
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Instance spawned successfully.
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284428.0054288, 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] VM Started (Lifecycle Event)
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Took 6.16 seconds to spawn the instance on the hypervisor.
Aug 17 15:00:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:00:28 user nova-compute[73079]: INFO nova.compute.manager [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Took 7.11 seconds to build instance.
Aug 17 15:00:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-940ac703-92dd-47e0-9027-63c72416de35 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.511s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:00:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:00:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:00:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:00:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:00:48 user nova-compute[73079]: INFO nova.compute.claims [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Claim successful on node user
Aug 17 15:00:48 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:00:49 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:00:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:00:49 user nova-compute[73079]: INFO nova.virt.block_device [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Booting with volume 7680a124-ef70-4f8c-8b3f-fd9cc24f42fa at /dev/vda
Aug 17 15:00:49 user nova-compute[73079]: DEBUG nova.policy [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '722f38129c96487b8331cde0ab317832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9478b753e2040e799f28e18c5a82223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG os_brick.utils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a9f96b-10c8-4dff-996b-ce734b1b8404]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2edee5c-8cb8-49fd-b138-199fc9e482a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf3c8d-7318-4674-a8a5-3d4f680e614c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[823d5293-671d-45bd-bc67-d82509118808]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:00:49 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:00:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[999c76b1-a07a-41e9-be25-ae83c67e05f3]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG os_brick.utils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updating existing volume attachment record: f3c0d68b-9e20-4582-a62e-0e0d88301e5a {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:00:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Successfully created port: ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Successfully updated port: ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquired lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-changed-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Refreshing instance network info cache due to event network-changed-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] Acquiring lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updating instance_info_cache with network_info: [{"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Releasing lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Instance network_info: |[{"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] Acquired lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Refreshing network info cache for port ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updated VIF entry in instance network info cache for port ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updating instance_info_cache with network_info: [{"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-42edc919-09dc-414d-a8ab-a17f9a1c6965 req-9d9496aa-d4c4-4b63-bbb0-212e3bca44c8 service nova] Releasing lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:00:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "798284c1-c697-4048-a9e6-382efa5ee684" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:53 user nova-compute[73079]: INFO nova.compute.manager [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Terminating instance
Aug 17 15:00:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-3048662c-c418-4600-ba00-d46bf63a3d0e req-725d46a0-67b5-476e-8d12-5edb45166b3f service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-vif-unplugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3048662c-c418-4600-ba00-d46bf63a3d0e req-725d46a0-67b5-476e-8d12-5edb45166b3f service nova] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3048662c-c418-4600-ba00-d46bf63a3d0e req-725d46a0-67b5-476e-8d12-5edb45166b3f service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3048662c-c418-4600-ba00-d46bf63a3d0e req-725d46a0-67b5-476e-8d12-5edb45166b3f service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-3048662c-c418-4600-ba00-d46bf63a3d0e req-725d46a0-67b5-476e-8d12-5edb45166b3f service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] No waiting events found dispatching network-vif-unplugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:00:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-3048662c-c418-4600-ba00-d46bf63a3d0e req-725d46a0-67b5-476e-8d12-5edb45166b3f service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-vif-unplugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:00:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Instance destroyed successfully.
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lazy-loading 'resources' on Instance uuid 798284c1-c697-4048-a9e6-382efa5ee684 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1300453686',display_name='tempest-VolumesActionsTest-instance-1300453686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1300453686',id=33,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0ea26ddbec745688fc8d2b4e64f6189',ramdisk_id='',reservation_id='r-pb0y784c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1721904385',owner_user_name='tempest-VolumesActionsTest-1721904385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:58:58Z,user_data=None,user_id='8aacbb819abc4ff080673f4a1a1314f7',uuid=798284c1-c697-4048-a9e6-382efa5ee684,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Converting VIF {"id": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "address": "fa:16:3e:f6:8f:d9", "network": {"id": "79d5559b-948d-4d8e-84b6-40077668e19c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1835741766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0ea26ddbec745688fc8d2b4e64f6189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccb63dda-1c", "ovs_interfaceid": "ccb63dda-1ca2-4601-bcc6-414c7bf1acdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG os_vif [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccb63dda-1c, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:00:54 user nova-compute[73079]: INFO os_vif [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:8f:d9,bridge_name='br-int',has_traffic_filtering=True,id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb,network=Network(79d5559b-948d-4d8e-84b6-40077668e19c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccb63dda-1c')
Aug 17 15:00:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Deleting instance files /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684_del
Aug 17 15:00:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Deletion of /opt/stack/data/nova/instances/798284c1-c697-4048-a9e6-382efa5ee684_del complete
Aug 17 15:00:54 user nova-compute[73079]: INFO nova.compute.manager [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 17 15:00:54 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:54 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Took 0.44 seconds to deallocate network for instance.
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-c0f100ba-8cca-44a3-ac8a-6cc2aac4f5c7 req-f640f31c-06bd-489c-b26e-61cce66c083c service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-vif-deleted-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:54 user nova-compute[73079]: INFO nova.compute.manager [req-c0f100ba-8cca-44a3-ac8a-6cc2aac4f5c7 req-f640f31c-06bd-489c-b26e-61cce66c083c service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Neutron deleted interface ccb63dda-1ca2-4601-bcc6-414c7bf1acdb; detaching it from the instance and deleting it from the info cache
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.network.neutron [req-c0f100ba-8cca-44a3-ac8a-6cc2aac4f5c7 req-f640f31c-06bd-489c-b26e-61cce66c083c service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-c0f100ba-8cca-44a3-ac8a-6cc2aac4f5c7 req-f640f31c-06bd-489c-b26e-61cce66c083c service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Detach interface failed, port_id=ccb63dda-1ca2-4601-bcc6-414c7bf1acdb, reason: Instance 798284c1-c697-4048-a9e6-382efa5ee684 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:54 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:00:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:00:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:55 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Deleted allocations for instance 798284c1-c697-4048-a9e6-382efa5ee684
Aug 17 15:00:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6f4f1282-cc3e-4c8b-ad36-be8e35fa6c87 tempest-VolumesActionsTest-1721904385 tempest-VolumesActionsTest-1721904385-project-member] Lock "798284c1-c697-4048-a9e6-382efa5ee684" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.606s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-8b72b3df-a5b9-40ea-82f3-47be634e9ed8 req-df4aa48a-a56e-4b81-8844-e39647e4eea8 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received event network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:00:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8b72b3df-a5b9-40ea-82f3-47be634e9ed8 req-df4aa48a-a56e-4b81-8844-e39647e4eea8 service nova] Acquiring lock "798284c1-c697-4048-a9e6-382efa5ee684-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:00:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8b72b3df-a5b9-40ea-82f3-47be634e9ed8 req-df4aa48a-a56e-4b81-8844-e39647e4eea8 service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:00:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8b72b3df-a5b9-40ea-82f3-47be634e9ed8 req-df4aa48a-a56e-4b81-8844-e39647e4eea8 service nova] Lock "798284c1-c697-4048-a9e6-382efa5ee684-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:00:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-8b72b3df-a5b9-40ea-82f3-47be634e9ed8 req-df4aa48a-a56e-4b81-8844-e39647e4eea8 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] No waiting events found dispatching network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:00:56 user nova-compute[73079]: WARNING nova.compute.manager [req-8b72b3df-a5b9-40ea-82f3-47be634e9ed8 req-df4aa48a-a56e-4b81-8844-e39647e4eea8 service nova] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Received unexpected event network-vif-plugged-ccb63dda-1ca2-4601-bcc6-414c7bf1acdb for instance with vm_state deleted and task_state None.
Aug 17 15:00:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:00:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:01:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Creating image(s)
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Ensure instance console log exists: /opt/stack/data/nova/instances/11f131b9-b7a2-4020-a92a-4cc24bfc4d11/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Start _get_guest_xml network_info=[{"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'f3c0d68b-9e20-4582-a62e-0e0d88301e5a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11f131b9-b7a2-4020-a92a-4cc24bfc4d11', 'attached_at': '', 'detached_at': '', 'volume_id': '7680a124-ef70-4f8c-8b3f-fd9cc24f42fa', 'serial': '7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:01:00 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:01:00 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:01:00 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:01:00 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:01:00 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1653a8-3f86-44ce-be6e-52650098048a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:01:00 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b09fd9-c5ba-4e9b-8335-6f5bc5e201ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa] added
Aug 17 15:01:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c604b9-b785-4c77-8522-146885ec1504]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a93ba56-fa58-42cb-9770-5748cc9934ef]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fCalKBXP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fCalKBXP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4ed1e-cb27-46a8-a911-5d846614b1be]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fCalKBXP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e700f14e-7d6f-424a-96c6-2f8869e09b94]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a8d60-b891-41d1-a761-4dc568572b5d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8ac863-5b56-4b7e-ae0d-571c9a86e9ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]
Aug 17 15:01:00 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.
Aug 17 15:01:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577266f-dfa8-4060-8019-e825fe91c420]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ca49d-b08b-4562-8f03-d6d68b03c9e7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:00 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:00 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272843d-6e59-494e-9efe-fecead9e2d1b]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:00 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26535366163316366', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535366163316366', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588160546',display_name='tempest-TestVolumeBootPattern-server-588160546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588160546',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-lc10vagx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:00:49Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=11f131b9-b7a2-4020-a92a-4cc24bfc4d11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'pci_devices' on Instance uuid 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:01:01 user nova-compute[73079]:   <uuid>11f131b9-b7a2-4020-a92a-4cc24bfc4d11</uuid>
Aug 17 15:01:01 user nova-compute[73079]:   <name>instance-00000025</name>
Aug 17 15:01:01 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:01:01 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:01:01 user nova-compute[73079]:   <metadata>
Aug 17 15:01:01 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:01:01 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:01:01 user nova-compute[73079]:       <nova:name>tempest-TestVolumeBootPattern-server-588160546</nova:name>
Aug 17 15:01:01 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:01:00</nova:creationTime>
Aug 17 15:01:01 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:01:01 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:01:01 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:01:01 user nova-compute[73079]:       <nova:owner>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:user uuid="722f38129c96487b8331cde0ab317832">tempest-TestVolumeBootPattern-1112851866-project-member</nova:user>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:project uuid="c9478b753e2040e799f28e18c5a82223">tempest-TestVolumeBootPattern-1112851866</nova:project>
Aug 17 15:01:01 user nova-compute[73079]:       </nova:owner>
Aug 17 15:01:01 user nova-compute[73079]:       <nova:ports>
Aug 17 15:01:01 user nova-compute[73079]:         <nova:port uuid="ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50">
Aug 17 15:01:01 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:01:01 user nova-compute[73079]:         </nova:port>
Aug 17 15:01:01 user nova-compute[73079]:       </nova:ports>
Aug 17 15:01:01 user nova-compute[73079]:     </nova:instance>
Aug 17 15:01:01 user nova-compute[73079]:   </metadata>
Aug 17 15:01:01 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:01:01 user nova-compute[73079]:     <system>
Aug 17 15:01:01 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:01:01 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:01:01 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:01:01 user nova-compute[73079]:       <entry name="serial">11f131b9-b7a2-4020-a92a-4cc24bfc4d11</entry>
Aug 17 15:01:01 user nova-compute[73079]:       <entry name="uuid">11f131b9-b7a2-4020-a92a-4cc24bfc4d11</entry>
Aug 17 15:01:01 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:01:01 user nova-compute[73079]:     </system>
Aug 17 15:01:01 user nova-compute[73079]:   </sysinfo>
Aug 17 15:01:01 user nova-compute[73079]:   <os>
Aug 17 15:01:01 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:01:01 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:01:01 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:01:01 user nova-compute[73079]:   </os>
Aug 17 15:01:01 user nova-compute[73079]:   <features>
Aug 17 15:01:01 user nova-compute[73079]:     <acpi/>
Aug 17 15:01:01 user nova-compute[73079]:     <apic/>
Aug 17 15:01:01 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:01:01 user nova-compute[73079]:   </features>
Aug 17 15:01:01 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:01:01 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:01:01 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:01:01 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:01:01 user nova-compute[73079]:   </clock>
Aug 17 15:01:01 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:01:01 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:01:01 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:01:01 user nova-compute[73079]:   </cpu>
Aug 17 15:01:01 user nova-compute[73079]:   <devices>
Aug 17 15:01:01 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:01:01 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:01:01 user nova-compute[73079]:       <source dev="/dev/sdc"/>
Aug 17 15:01:01 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:01:01 user nova-compute[73079]:       <serial>7680a124-ef70-4f8c-8b3f-fd9cc24f42fa</serial>
Aug 17 15:01:01 user nova-compute[73079]:     </disk>
Aug 17 15:01:01 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:01:01 user nova-compute[73079]:       <mac address="fa:16:3e:0d:f7:7e"/>
Aug 17 15:01:01 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:01:01 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:01:01 user nova-compute[73079]:       <target dev="tapea1bdd3c-10"/>
Aug 17 15:01:01 user nova-compute[73079]:     </interface>
Aug 17 15:01:01 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:01:01 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/11f131b9-b7a2-4020-a92a-4cc24bfc4d11/console.log" append="off"/>
Aug 17 15:01:01 user nova-compute[73079]:     </serial>
Aug 17 15:01:01 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:01:01 user nova-compute[73079]:     <video>
Aug 17 15:01:01 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:01:01 user nova-compute[73079]:     </video>
Aug 17 15:01:01 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:01:01 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:01:01 user nova-compute[73079]:     </rng>
Aug 17 15:01:01 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:01:01 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:01:01 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:01:01 user nova-compute[73079]:     </memballoon>
Aug 17 15:01:01 user nova-compute[73079]:   </devices>
Aug 17 15:01:01 user nova-compute[73079]: </domain>
Aug 17 15:01:01 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588160546',display_name='tempest-TestVolumeBootPattern-server-588160546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588160546',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-lc10vagx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:00:49Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=11f131b9-b7a2-4020-a92a-4cc24bfc4d11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG os_vif [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea1bdd3c-10, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea1bdd3c-10, col_values=(('external_ids', {'iface-id': 'ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f7:7e', 'vm-uuid': '11f131b9-b7a2-4020-a92a-4cc24bfc4d11'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:01 user nova-compute[73079]: INFO os_vif [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10')
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:01:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No VIF found with MAC fa:16:3e:0d:f7:7e, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-66e2ccb0-4f0c-4c97-8566-66e2ba8d337c req-6ee8711d-40c0-4c61-b4a4-345f8a0b94f5 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-66e2ccb0-4f0c-4c97-8566-66e2ba8d337c req-6ee8711d-40c0-4c61-b4a4-345f8a0b94f5 service nova] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-66e2ccb0-4f0c-4c97-8566-66e2ba8d337c req-6ee8711d-40c0-4c61-b4a4-345f8a0b94f5 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-66e2ccb0-4f0c-4c97-8566-66e2ba8d337c req-6ee8711d-40c0-4c61-b4a4-345f8a0b94f5 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-66e2ccb0-4f0c-4c97-8566-66e2ba8d337c req-6ee8711d-40c0-4c61-b4a4-345f8a0b94f5 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] No waiting events found dispatching network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:01:02 user nova-compute[73079]: WARNING nova.compute.manager [req-66e2ccb0-4f0c-4c97-8566-66e2ba8d337c req-6ee8711d-40c0-4c61-b4a4-345f8a0b94f5 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received unexpected event network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 for instance with vm_state building and task_state spawning.
Aug 17 15:01:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284464.887614, 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:01:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] VM Resumed (Lifecycle Event)
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:01:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Instance spawned successfully.
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284464.8887863, 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:01:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] VM Started (Lifecycle Event)
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:01:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:01:05 user nova-compute[73079]: INFO nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 17 15:01:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d780450-50c6-4617-8466-b52bee01dc5f req-70e9bcfa-46fc-4a87-b21b-b9ab4381f5c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:01:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d780450-50c6-4617-8466-b52bee01dc5f req-70e9bcfa-46fc-4a87-b21b-b9ab4381f5c8 service nova] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d780450-50c6-4617-8466-b52bee01dc5f req-70e9bcfa-46fc-4a87-b21b-b9ab4381f5c8 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d780450-50c6-4617-8466-b52bee01dc5f req-70e9bcfa-46fc-4a87-b21b-b9ab4381f5c8 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d780450-50c6-4617-8466-b52bee01dc5f req-70e9bcfa-46fc-4a87-b21b-b9ab4381f5c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] No waiting events found dispatching network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:01:05 user nova-compute[73079]: WARNING nova.compute.manager [req-5d780450-50c6-4617-8466-b52bee01dc5f req-70e9bcfa-46fc-4a87-b21b-b9ab4381f5c8 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received unexpected event network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 for instance with vm_state building and task_state spawning.
Aug 17 15:01:05 user nova-compute[73079]: INFO nova.compute.manager [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Took 16.43 seconds to build instance.
Aug 17 15:01:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1ca20794-c5fc-4352-8bf2-635862ff9330 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.623s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:09 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284454.122781, 798284c1-c697-4048-a9e6-382efa5ee684 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:01:09 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] VM Stopped (Lifecycle Event)
Aug 17 15:01:09 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cb313602-3ce5-43b0-bec6-23e134056b97 None None] [instance: 798284c1-c697-4048-a9e6-382efa5ee684] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:10 user nova-compute[73079]: INFO nova.compute.manager [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] instance snapshotting
Aug 17 15:01:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Beginning live snapshot process
Aug 17 15:01:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo6ghnttv/3f6f2ed632614d5b81eaec1c8062c1fa.delta 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo6ghnttv/3f6f2ed632614d5b81eaec1c8062c1fa.delta 1073741824" returned: 0 in 0.047s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:11 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 15:01:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] COPY block job progress, current cursor: 1376256 final cursor: 75497472 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 15:01:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 15:01:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 15:01:12 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 15:01:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo6ghnttv/3f6f2ed632614d5b81eaec1c8062c1fa.delta /opt/stack/data/nova/instances/snapshots/tmpo6ghnttv/3f6f2ed632614d5b81eaec1c8062c1fa {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo6ghnttv/3f6f2ed632614d5b81eaec1c8062c1fa.delta /opt/stack/data/nova/instances/snapshots/tmpo6ghnttv/3f6f2ed632614d5b81eaec1c8062c1fa" returned: 0 in 0.567s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Snapshot extracted, beginning image upload
Aug 17 15:01:15 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Snapshot image upload complete
Aug 17 15:01:15 user nova-compute[73079]: INFO nova.compute.manager [None req-b733ae7f-cb2d-46fc-ba1d-235a4552ff8e tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Took 4.87 seconds to snapshot the instance on the hypervisor.
Aug 17 15:01:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:01:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:01:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-changed-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Refreshing instance network info cache due to event network-changed-657f7df0-44a2-48e6-8e99-45c31bd06427. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] Acquiring lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] Acquired lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Refreshing network info cache for port 657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updated VIF entry in instance network info cache for port 657f7df0-44a2-48e6-8e99-45c31bd06427. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updating instance_info_cache with network_info: [{"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8c452fba-7a7f-48b7-af16-0adb0b79250f req-90f4ebee-1a5f-40d6-9de8-a28b3ee864f8 service nova] Releasing lock "refresh_cache-7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:01:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:01:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:01:20 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.200462341308594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:01:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:01:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:22 user nova-compute[73079]: INFO nova.compute.manager [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Attaching volume 88cb6776-b07e-4ab2-abb9-200e30bc0fac to /dev/vdb
Aug 17 15:01:22 user nova-compute[73079]: DEBUG os_brick.utils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe9c09-de3f-43c8-8434-5ba29ebb6411]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d066a0b9-9384-4278-86f9-dccf7e048a7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[381aaf7b-5603-4f1f-a57f-f61c808fb25e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[28641d07-5385-4b29-94af-a1c4aa151e5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:01:22 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:01:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4102768-46ac-43f5-843d-8025ab7b1b91]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG os_brick.utils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updating existing volume attachment record: 38c4679b-a761-451c-aa2d-fc3fa3897fec {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:01:22 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:01:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:01:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:01:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBjAOvLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:01:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:01:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:01:33 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f74641-2c4b-462e-a0ad-59b183a8c2c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:01:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725cf5a-cf15-497e-b957-c4befc6ecca3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac] added
Aug 17 15:01:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac6dbd-0a19-4a5a-8846-b8acb646bcbe]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[543dacae-98a8-456c-84c3-fa0b7ff0222f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBjAOvLx {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBjAOvLx" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[14465b94-5854-4c4d-9945-54b224516580]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBjAOvLx'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf155a8-ee4f-4949-b217-0bbddb4ee3b0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79b9121-bf9c-4d52-b03d-b70fcb7c5fb8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:33 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:33 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b9c3ea-5c3d-4c86-af30-cdc5c0ccdee9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260]
Aug 17 15:01:33 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260] successful.
Aug 17 15:01:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d96b37-1219-4548-962e-a2fdea01f033]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd52b0-8234-4749-998d-9b1183f00ab0]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:33 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:33 user nova-compute[73079]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac (non-flash)
Aug 17 15:01:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:33 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:33 user nova-compute[73079]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac (non-flash)
Aug 17 15:01:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8913bb7-c9cb-4c46-8ea0-d710360d0814]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBjAOvLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26235336132613065', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235336132613065', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:01:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:01:34 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:01:34 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:01:34 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:01:34 user nova-compute[73079]:   <serial>88cb6776-b07e-4ab2-abb9-200e30bc0fac</serial>
Aug 17 15:01:34 user nova-compute[73079]: </disk>
Aug 17 15:01:34 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:01:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:01:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:01:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] No VIF found with MAC fa:16:3e:a2:7a:0b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:01:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-76a108a8-f55f-45a6-a5a2-b01a172d28c8 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.662s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:35 user nova-compute[73079]: INFO nova.compute.manager [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Detaching volume 88cb6776-b07e-4ab2-abb9-200e30bc0fac
Aug 17 15:01:36 user nova-compute[73079]: INFO nova.virt.block_device [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Attempting to driver detach volume 88cb6776-b07e-4ab2-abb9-200e30bc0fac from mountpoint /dev/vdb
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Attempting to detach device vdb from instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:01:36 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:01:36 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:01:36 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:01:36 user nova-compute[73079]:   <serial>88cb6776-b07e-4ab2-abb9-200e30bc0fac</serial>
Aug 17 15:01:36 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:01:36 user nova-compute[73079]: </disk>
Aug 17 15:01:36 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:01:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully detached device vdb from instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 from the persistent domain config.
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:01:36 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:01:36 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:01:36 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:01:36 user nova-compute[73079]:   <serial>88cb6776-b07e-4ab2-abb9-200e30bc0fac</serial>
Aug 17 15:01:36 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:01:36 user nova-compute[73079]: </disk>
Aug 17 15:01:36 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284496.5412922, 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:01:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully detached device vdb from instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 from the live domain config.
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBjAOvLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:01:36 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31247c8-b702-4e4a-aad7-ee5ef48b477e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97907d5-634e-41e6-9704-268ab9d918f7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:36 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:36 user nova-compute[73079]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac (non-flash)
Aug 17 15:01:36 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:01:36 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:01:36 user nova-compute[73079]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac (non-flash)
Aug 17 15:01:36 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f50fb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943306b-50ea-4659-b1a1-5d285a5a60de]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dec6e9-0d08-4b39-b9ae-3ff439efa71e]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9abb7-8570-4285-b1e4-3dc4aad83f60]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[104e8bb3-c4fc-42c3-ad04-ad90a77d3c9e]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ac15b-702f-4bc6-a8ec-22618fe90e98]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd407212-e29e-4392-ae0e-f1653a4ccf3e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260]
Aug 17 15:01:36 user nova-compute[73079]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac, portal: 172.16.0.220,3260] successful.
Aug 17 15:01:36 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cb6776-b07e-4ab2-abb9-200e30bc0fac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6740278-0d0e-4410-8888-0c17d01f09c1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] <== disconnect_volume: return (283ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:01:36 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:01:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:37 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'flavor' on Instance uuid 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:01:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8bcb2267-ef95-47e3-9c98-22af1d40e5b7 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.887s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:01:46 user nova-compute[73079]: INFO nova.compute.claims [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Claim successful on node user
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.network.neutron [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:01:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.policy [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcfb392dca9d4008b1ca9655cedaef6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13613dce4b924a33b76cdfac1a23cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:01:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Creating image(s)
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk 1073741824" returned: 0 in 0.059s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Successfully created port: bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Cannot resize image /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG nova.objects.instance [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'migration_context' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Ensure instance console log exists: /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Successfully updated port: bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquired lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-changed-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Refreshing instance network info cache due to event network-changed-bd8b26ce-779d-4b58-98af-15a67ac1373d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] Acquiring lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updating instance_info_cache with network_info: [{"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Releasing lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance network_info: |[{"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] Acquired lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Refreshing network info cache for port bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Start _get_guest_xml network_info=[{"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:01:49 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:01:49 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1172900661',display_name='tempest-tempest.common.compute-instance-1172900661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1172900661',id=38,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX+AAtt4TkrBADqts0gHca3h7/0Z3/nMtYXzIkLvV367jDT+K3GZ9xwHFbrS82LunQOYn68jsDE2hEwj7rYxOxBwjRbLJP1WBFakRnUTWIyzJ4fXBInNNvIWj2q92INqA==',key_name='tempest-keypair-2084706945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-r80y8dew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=b7fce05e-80ca-4a0f-950c-3c0933e5531a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_devices' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:01:49 user nova-compute[73079]:   <uuid>b7fce05e-80ca-4a0f-950c-3c0933e5531a</uuid>
Aug 17 15:01:49 user nova-compute[73079]:   <name>instance-00000026</name>
Aug 17 15:01:49 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:01:49 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:01:49 user nova-compute[73079]:   <metadata>
Aug 17 15:01:49 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:01:49 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:01:49 user nova-compute[73079]:       <nova:name>tempest-tempest.common.compute-instance-1172900661</nova:name>
Aug 17 15:01:49 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:01:49</nova:creationTime>
Aug 17 15:01:49 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:01:49 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:01:49 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:01:49 user nova-compute[73079]:       <nova:owner>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:user uuid="bcfb392dca9d4008b1ca9655cedaef6c">tempest-ServerActionsTestOtherA-1400100504-project-member</nova:user>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:project uuid="13613dce4b924a33b76cdfac1a23cb3c">tempest-ServerActionsTestOtherA-1400100504</nova:project>
Aug 17 15:01:49 user nova-compute[73079]:       </nova:owner>
Aug 17 15:01:49 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:01:49 user nova-compute[73079]:       <nova:ports>
Aug 17 15:01:49 user nova-compute[73079]:         <nova:port uuid="bd8b26ce-779d-4b58-98af-15a67ac1373d">
Aug 17 15:01:49 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:01:49 user nova-compute[73079]:         </nova:port>
Aug 17 15:01:49 user nova-compute[73079]:       </nova:ports>
Aug 17 15:01:49 user nova-compute[73079]:     </nova:instance>
Aug 17 15:01:49 user nova-compute[73079]:   </metadata>
Aug 17 15:01:49 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:01:49 user nova-compute[73079]:     <system>
Aug 17 15:01:49 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:01:49 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:01:49 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:01:49 user nova-compute[73079]:       <entry name="serial">b7fce05e-80ca-4a0f-950c-3c0933e5531a</entry>
Aug 17 15:01:49 user nova-compute[73079]:       <entry name="uuid">b7fce05e-80ca-4a0f-950c-3c0933e5531a</entry>
Aug 17 15:01:49 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:01:49 user nova-compute[73079]:     </system>
Aug 17 15:01:49 user nova-compute[73079]:   </sysinfo>
Aug 17 15:01:49 user nova-compute[73079]:   <os>
Aug 17 15:01:49 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:01:49 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:01:49 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:01:49 user nova-compute[73079]:   </os>
Aug 17 15:01:49 user nova-compute[73079]:   <features>
Aug 17 15:01:49 user nova-compute[73079]:     <acpi/>
Aug 17 15:01:49 user nova-compute[73079]:     <apic/>
Aug 17 15:01:49 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:01:49 user nova-compute[73079]:   </features>
Aug 17 15:01:49 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:01:49 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:01:49 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:01:49 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:01:49 user nova-compute[73079]:   </clock>
Aug 17 15:01:49 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:01:49 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:01:49 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:01:49 user nova-compute[73079]:   </cpu>
Aug 17 15:01:49 user nova-compute[73079]:   <devices>
Aug 17 15:01:49 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:01:49 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:01:49 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk"/>
Aug 17 15:01:49 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:01:49 user nova-compute[73079]:     </disk>
Aug 17 15:01:49 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:01:49 user nova-compute[73079]:       <mac address="fa:16:3e:0b:c6:57"/>
Aug 17 15:01:49 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:01:49 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:01:49 user nova-compute[73079]:       <target dev="tapbd8b26ce-77"/>
Aug 17 15:01:49 user nova-compute[73079]:     </interface>
Aug 17 15:01:49 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:01:49 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/console.log" append="off"/>
Aug 17 15:01:49 user nova-compute[73079]:     </serial>
Aug 17 15:01:49 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:01:49 user nova-compute[73079]:     <video>
Aug 17 15:01:49 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:01:49 user nova-compute[73079]:     </video>
Aug 17 15:01:49 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:01:49 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:01:49 user nova-compute[73079]:     </rng>
Aug 17 15:01:49 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:01:49 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:01:49 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:01:49 user nova-compute[73079]:     </memballoon>
Aug 17 15:01:49 user nova-compute[73079]:   </devices>
Aug 17 15:01:49 user nova-compute[73079]: </domain>
Aug 17 15:01:49 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1172900661',display_name='tempest-tempest.common.compute-instance-1172900661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1172900661',id=38,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX+AAtt4TkrBADqts0gHca3h7/0Z3/nMtYXzIkLvV367jDT+K3GZ9xwHFbrS82LunQOYn68jsDE2hEwj7rYxOxBwjRbLJP1WBFakRnUTWIyzJ4fXBInNNvIWj2q92INqA==',key_name='tempest-keypair-2084706945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-r80y8dew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=b7fce05e-80ca-4a0f-950c-3c0933e5531a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG os_vif [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd8b26ce-77, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd8b26ce-77, col_values=(('external_ids', {'iface-id': 'bd8b26ce-779d-4b58-98af-15a67ac1373d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c6:57', 'vm-uuid': 'b7fce05e-80ca-4a0f-950c-3c0933e5531a'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:49 user nova-compute[73079]: INFO os_vif [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77')
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:01:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No VIF found with MAC fa:16:3e:0b:c6:57, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:01:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updated VIF entry in instance network info cache for port bd8b26ce-779d-4b58-98af-15a67ac1373d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:01:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updating instance_info_cache with network_info: [{"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:01:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-006a0176-09c1-490c-ae4a-af636ca56dc6 req-97187f79-50eb-4534-875a-8fa268f1b68b service nova] Releasing lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:01:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-275c0837-a0aa-48c5-be4e-c6cb7ec9d4dd req-cbf91a8d-274b-4b6b-a205-870338f3cfb0 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-275c0837-a0aa-48c5-be4e-c6cb7ec9d4dd req-cbf91a8d-274b-4b6b-a205-870338f3cfb0 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-275c0837-a0aa-48c5-be4e-c6cb7ec9d4dd req-cbf91a8d-274b-4b6b-a205-870338f3cfb0 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-275c0837-a0aa-48c5-be4e-c6cb7ec9d4dd req-cbf91a8d-274b-4b6b-a205-870338f3cfb0 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-275c0837-a0aa-48c5-be4e-c6cb7ec9d4dd req-cbf91a8d-274b-4b6b-a205-870338f3cfb0 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:01:51 user nova-compute[73079]: WARNING nova.compute.manager [req-275c0837-a0aa-48c5-be4e-c6cb7ec9d4dd req-cbf91a8d-274b-4b6b-a205-870338f3cfb0 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state building and task_state spawning.
Aug 17 15:01:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284513.2577932, b7fce05e-80ca-4a0f-950c-3c0933e5531a => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] VM Resumed (Lifecycle Event)
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance spawned successfully.
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-8fbe824b-9887-46ce-ae0a-2b3b530690c5 req-5d9ee6f9-ddcb-4349-b2a8-7c2da0661858 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8fbe824b-9887-46ce-ae0a-2b3b530690c5 req-5d9ee6f9-ddcb-4349-b2a8-7c2da0661858 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8fbe824b-9887-46ce-ae0a-2b3b530690c5 req-5d9ee6f9-ddcb-4349-b2a8-7c2da0661858 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8fbe824b-9887-46ce-ae0a-2b3b530690c5 req-5d9ee6f9-ddcb-4349-b2a8-7c2da0661858 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [req-8fbe824b-9887-46ce-ae0a-2b3b530690c5 req-5d9ee6f9-ddcb-4349-b2a8-7c2da0661858 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:01:53 user nova-compute[73079]: WARNING nova.compute.manager [req-8fbe824b-9887-46ce-ae0a-2b3b530690c5 req-5d9ee6f9-ddcb-4349-b2a8-7c2da0661858 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state building and task_state spawning.
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284513.2598546, b7fce05e-80ca-4a0f-950c-3c0933e5531a => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] VM Started (Lifecycle Event)
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 17 15:01:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:01:53 user nova-compute[73079]: INFO nova.compute.manager [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Took 6.55 seconds to build instance.
Aug 17 15:01:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-41f32472-fd65-4ccf-b7df-078615191fd7 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:01:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:01:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:01:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:01:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:01:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:01:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:04 user nova-compute[73079]: INFO nova.compute.manager [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Terminating instance
Aug 17 15:02:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-1384766e-a0fe-4e15-b30a-d239edc9af89 req-98d95794-ef56-4a03-ba6e-74adcf63a2c1 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-vif-unplugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1384766e-a0fe-4e15-b30a-d239edc9af89 req-98d95794-ef56-4a03-ba6e-74adcf63a2c1 service nova] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1384766e-a0fe-4e15-b30a-d239edc9af89 req-98d95794-ef56-4a03-ba6e-74adcf63a2c1 service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1384766e-a0fe-4e15-b30a-d239edc9af89 req-98d95794-ef56-4a03-ba6e-74adcf63a2c1 service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-1384766e-a0fe-4e15-b30a-d239edc9af89 req-98d95794-ef56-4a03-ba6e-74adcf63a2c1 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] No waiting events found dispatching network-vif-unplugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-1384766e-a0fe-4e15-b30a-d239edc9af89 req-98d95794-ef56-4a03-ba6e-74adcf63a2c1 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-vif-unplugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:02:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Instance destroyed successfully.
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lazy-loading 'resources' on Instance uuid e1bec80a-f4a5-4df0-b02d-660865f4e0a7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1571305615',display_name='tempest-SnapshotDataIntegrityTests-server-1571305615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1571305615',id=27,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKuyaeYCDLwXPtmpDtFbuC3Atk8OKxMDiH+g+Cgr4ikDkrS3MEOhJc8edKcqkTKDOOPcuj9CPA7OVtme5kqBWJ82AELGh+HtEyLQ2SA0cjDu0myPqL2YDNihFufSv9WWA==',key_name='tempest-keypair-1191235343',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:54:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b78138dae3ab40718afcfc642e8af731',ramdisk_id='',reservation_id='r-7z8f0ms8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-521184253',owner_user_name='tempest-SnapshotDataIntegrityTests-521184253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5be2577e42ea4028a65428b5f86520b6',uuid=e1bec80a-f4a5-4df0-b02d-660865f4e0a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Converting VIF {"id": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "address": "fa:16:3e:ca:e5:50", "network": {"id": "5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-952127043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78138dae3ab40718afcfc642e8af731", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd65468eb-ac", "ovs_interfaceid": "d65468eb-accc-4f0a-8fdb-5fdf8020f7b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG os_vif [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd65468eb-ac, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:02:05 user nova-compute[73079]: INFO os_vif [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e5:50,bridge_name='br-int',has_traffic_filtering=True,id=d65468eb-accc-4f0a-8fdb-5fdf8020f7b5,network=Network(5a7bdbd4-bdef-4c4a-89b2-00212dfe28c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd65468eb-ac')
Aug 17 15:02:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Deleting instance files /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7_del
Aug 17 15:02:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Deletion of /opt/stack/data/nova/instances/e1bec80a-f4a5-4df0-b02d-660865f4e0a7_del complete
Aug 17 15:02:05 user nova-compute[73079]: INFO nova.compute.manager [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 15:02:05 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:02:05 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:06 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Took 0.81 seconds to deallocate network for instance.
Aug 17 15:02:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-e6775878-3a78-46af-991c-908e66c1cb72 req-c996cb9b-ece1-4b8b-8826-5eaebe0aa685 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-vif-deleted-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:06 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Deleted allocations for instance e1bec80a-f4a5-4df0-b02d-660865f4e0a7
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-476bbbd2-8415-4617-8ecb-87a82b5bcc3a tempest-SnapshotDataIntegrityTests-521184253 tempest-SnapshotDataIntegrityTests-521184253-project-member] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.244s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-959e1b7f-6619-41e1-ab8f-685b5a701c98 req-24b39899-b5b2-44ae-ac43-94b0e893b2d8 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received event network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-959e1b7f-6619-41e1-ab8f-685b5a701c98 req-24b39899-b5b2-44ae-ac43-94b0e893b2d8 service nova] Acquiring lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-959e1b7f-6619-41e1-ab8f-685b5a701c98 req-24b39899-b5b2-44ae-ac43-94b0e893b2d8 service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-959e1b7f-6619-41e1-ab8f-685b5a701c98 req-24b39899-b5b2-44ae-ac43-94b0e893b2d8 service nova] Lock "e1bec80a-f4a5-4df0-b02d-660865f4e0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-959e1b7f-6619-41e1-ab8f-685b5a701c98 req-24b39899-b5b2-44ae-ac43-94b0e893b2d8 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] No waiting events found dispatching network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:06 user nova-compute[73079]: WARNING nova.compute.manager [req-959e1b7f-6619-41e1-ab8f-685b5a701c98 req-24b39899-b5b2-44ae-ac43-94b0e893b2d8 service nova] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Received unexpected event network-vif-plugged-d65468eb-accc-4f0a-8fdb-5fdf8020f7b5 for instance with vm_state deleted and task_state None.
Aug 17 15:02:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-changed-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Refreshing instance network info cache due to event network-changed-dd037561-804d-4905-a498-dc89d81555f3. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] Acquiring lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] Acquired lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.network.neutron [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Refreshing network info cache for port dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'flavor' on Instance uuid 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:02:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Ignoring supplied device name: /dev/vdb
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:12 user nova-compute[73079]: INFO nova.compute.manager [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Attaching volume b024e2c4-8568-4139-be83-b0258cd1e8b1 to /dev/vdb
Aug 17 15:02:12 user nova-compute[73079]: DEBUG os_brick.utils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ad8cc3-087a-45d8-a48f-65c082020882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8874ee52-8328-4bd2-aff3-99b94e995519]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[48051787-6725-4e49-8a35-b2f88c29a975]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec661ba-dba1-480c-877b-75e6c4acc5ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.network.neutron [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updated VIF entry in instance network info cache for port dd037561-804d-4905-a498-dc89d81555f3. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.network.neutron [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updating instance_info_cache with network_info: [{"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:02:12 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d0752-ebb6-4197-9075-1e32c49b3031]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG os_brick.utils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updating existing volume attachment record: 8ddfff90-fae0-40a7-a2cc-b46f9ebfbd50 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:02:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f85d3ca7-5d76-4caf-931b-1f8dc3351f39 req-c1e60285-4619-4e91-b637-009c2c5b6755 service nova] Releasing lock "refresh_cache-5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:02:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:15 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:02:17 user nova-compute[73079]: INFO nova.compute.claims [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Claim successful on node user
Aug 17 15:02:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:02:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:02:17 user nova-compute[73079]: INFO nova.virt.block_device [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Booting with volume-backed-image f1520146-7ad6-41ad-91e3-e68a652af0d4 at /dev/vda
Aug 17 15:02:17 user nova-compute[73079]: DEBUG nova.policy [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f67004af6654b5d80924a5c502a74f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd4ad5f2eb4e728a71908d32d353d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Successfully created port: 162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Successfully updated port: 162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-changed-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.compute.manager [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Refreshing instance network info cache due to event network-changed-162abcfd-c46e-45f8-b626-ff551ef3a40d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] Acquiring lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284525.0893683, e1bec80a-f4a5-4df0-b02d-660865f4e0a7 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:02:20 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] VM Stopped (Lifecycle Event)
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a98a89c0-013b-4c75-ad65-ba9d94aff919 None None] [instance: e1bec80a-f4a5-4df0-b02d-660865f4e0a7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating instance_info_cache with network_info: [{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance network_info: |[{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] Acquired lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Refreshing network info cache for port 162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:02:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updated VIF entry in instance network info cache for port 162abcfd-c46e-45f8-b626-ff551ef3a40d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating instance_info_cache with network_info: [{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7a64c7fa-f35c-4c3a-a789-632b6a349c72 req-79db8069-978c-4d3a-8f6c-88cf44b124a8 service nova] Releasing lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:21 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:02:21 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.18920135498047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b7fce05e-80ca-4a0f-950c-3c0933e5531a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:02:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:02:22 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:02:22 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:02:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:02:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMZiTXLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:02:24 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:02:24 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:02:24 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba243ff-4bf4-4283-8f53-075f9489b1f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:02:24 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59aacd7-8f8c-49be-8f8e-3b0869bc3bbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1] added
Aug 17 15:02:24 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7ca56b-fa1f-4c63-a898-db922b62a49a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[af622f2e-c697-42df-96d6-804d17166b81]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMZiTXLd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMZiTXLd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c6c34-a63c-496f-9962-8bbf4c96ce18]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nMZiTXLd'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7756900-1e91-430c-9e33-32549a716f96]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[254efc52-0687-481a-a814-e14ada9ec13e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:24 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:24 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:24 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:24 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[896f99b3-cd5f-43ed-8b5a-d2ce7b94eec8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260]
Aug 17 15:02:24 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260] successful.
Aug 17 15:02:24 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd9cfe5-b151-48fb-a19d-030b6c4441ad]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[39536605-c563-4f80-8798-8592c3eeaa1e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:24 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:24 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:24 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:24 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:24 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:24 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0caa66-a73e-44b6-a8c5-47233ec15370]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMZiTXLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26534353639363638', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534353639363638', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG nova.objects.instance [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'flavor' on Instance uuid 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:02:25 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:02:25 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:02:25 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:02:25 user nova-compute[73079]:   <serial>b024e2c4-8568-4139-be83-b0258cd1e8b1</serial>
Aug 17 15:02:25 user nova-compute[73079]: </disk>
Aug 17 15:02:25 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:02:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] No VIF found with MAC fa:16:3e:e1:f2:64, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:26 user nova-compute[73079]: INFO nova.compute.manager [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Terminating instance
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db426863-3855-41a5-9765-9b52b61df1b4 tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.597s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-6b6d9053-b4bf-43ec-806d-b7f4a1b3cbaf req-ff352471-7a21-4643-b8c4-eebf15cc6f3d service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-vif-unplugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6b6d9053-b4bf-43ec-806d-b7f4a1b3cbaf req-ff352471-7a21-4643-b8c4-eebf15cc6f3d service nova] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6b6d9053-b4bf-43ec-806d-b7f4a1b3cbaf req-ff352471-7a21-4643-b8c4-eebf15cc6f3d service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6b6d9053-b4bf-43ec-806d-b7f4a1b3cbaf req-ff352471-7a21-4643-b8c4-eebf15cc6f3d service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-6b6d9053-b4bf-43ec-806d-b7f4a1b3cbaf req-ff352471-7a21-4643-b8c4-eebf15cc6f3d service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] No waiting events found dispatching network-vif-unplugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-6b6d9053-b4bf-43ec-806d-b7f4a1b3cbaf req-ff352471-7a21-4643-b8c4-eebf15cc6f3d service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-vif-unplugged-657f7df0-44a2-48e6-8e99-45c31bd06427 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Instance destroyed successfully.
Aug 17 15:02:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lazy-loading 'resources' on Instance uuid 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1800947916',display_name='tempest-AttachVolumeNegativeTest-server-1800947916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1800947916',id=35,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu2mzKKTyMBNh8w7sGN821nSlIaRnL3nM6NyX9xpMsqiB67tEben8Vm9lQnT9hI637WL6p9ZHNCkk3RIpKFGDEkCwJs85wHdhDcnrXDiDJeP97rWZZSj0nw6H9mTZqKCA==',key_name='tempest-keypair-1965297056',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ac38bd75ed4e588b516582286bfb97',ramdisk_id='',reservation_id='r-wgz8t704',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-706656920',owner_user_name='tempest-AttachVolumeNegativeTest-706656920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7edb85ca3cd14d4587b951327e892bd6',uuid=7052d5fa-bc72-4f78-bd9d-0bcc29432ec5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converting VIF {"id": "657f7df0-44a2-48e6-8e99-45c31bd06427", "address": "fa:16:3e:a2:7a:0b", "network": {"id": "a0933650-80e5-4926-96da-fb05760fa9d9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-379575841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ac38bd75ed4e588b516582286bfb97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657f7df0-44", "ovs_interfaceid": "657f7df0-44a2-48e6-8e99-45c31bd06427", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG os_vif [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap657f7df0-44, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:27 user nova-compute[73079]: INFO os_vif [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:7a:0b,bridge_name='br-int',has_traffic_filtering=True,id=657f7df0-44a2-48e6-8e99-45c31bd06427,network=Network(a0933650-80e5-4926-96da-fb05760fa9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657f7df0-44')
Aug 17 15:02:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Deleting instance files /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5_del
Aug 17 15:02:27 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Deletion of /opt/stack/data/nova/instances/7052d5fa-bc72-4f78-bd9d-0bcc29432ec5_del complete
Aug 17 15:02:27 user nova-compute[73079]: INFO nova.compute.manager [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 15:02:27 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:02:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:28 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Took 1.03 seconds to deallocate network for instance.
Aug 17 15:02:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-5f5352b0-3277-441f-b18a-733cc6b3f8e0 req-9642ebf2-5927-41fc-8fe6-ec83f1dae526 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-vif-deleted-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:28 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Deleted allocations for instance 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3f5f9130-e445-49ef-bca3-d2e0fcd82f91 tempest-AttachVolumeNegativeTest-706656920 tempest-AttachVolumeNegativeTest-706656920-project-member] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.415s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad4b3aad-98ca-4927-8c43-9b05c198d4a5 req-05170e1e-54ee-4a44-957c-6ec6a54511d1 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received event network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad4b3aad-98ca-4927-8c43-9b05c198d4a5 req-05170e1e-54ee-4a44-957c-6ec6a54511d1 service nova] Acquiring lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad4b3aad-98ca-4927-8c43-9b05c198d4a5 req-05170e1e-54ee-4a44-957c-6ec6a54511d1 service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad4b3aad-98ca-4927-8c43-9b05c198d4a5 req-05170e1e-54ee-4a44-957c-6ec6a54511d1 service nova] Lock "7052d5fa-bc72-4f78-bd9d-0bcc29432ec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:28 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad4b3aad-98ca-4927-8c43-9b05c198d4a5 req-05170e1e-54ee-4a44-957c-6ec6a54511d1 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] No waiting events found dispatching network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:28 user nova-compute[73079]: WARNING nova.compute.manager [req-ad4b3aad-98ca-4927-8c43-9b05c198d4a5 req-05170e1e-54ee-4a44-957c-6ec6a54511d1 service nova] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Received unexpected event network-vif-plugged-657f7df0-44a2-48e6-8e99-45c31bd06427 for instance with vm_state deleted and task_state None.
Aug 17 15:02:29 user nova-compute[73079]: DEBUG os_brick.utils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e4348d-c927-4c9f-be4e-fdbcc1033f3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dec1c2-2713-425f-8854-2384e2e8348f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3c56d4-2c71-45da-a807-c5fcdb02b0b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb056aa-840f-4fe8-874b-31a1f17ee94b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:02:29 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:02:29 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead074a-da92-485b-9904-e4483a0c7bc7]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG os_brick.utils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:02:29 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating existing volume attachment record: 21da39cd-a1b6-4d4f-b579-19a06174d1ee {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:02:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:02:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:02:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:02:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:02:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:02:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Creating image(s)
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Ensure instance console log exists: /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Start _get_guest_xml network_info=[{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '21da39cd-a1b6-4d4f-b579-19a06174d1ee', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c2a7315-c524-4c66-9018-9f760bc3f2b6', 'attached_at': '', 'detached_at': '', 'volume_id': '38f9bf35-ed69-4781-9e55-b75e4fcfac69', 'serial': '38f9bf35-ed69-4781-9e55-b75e4fcfac69'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:02:40 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:02:40 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:02:40 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:02:40 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:02:40 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[55647050-7f94-4b52-9e0d-8ebfa8ed3f93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:02:40 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[927b07d6-71fe-4425-8eb8-e37577bd1f3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69] added
Aug 17 15:02:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f134cf-1047-40f5-9c81-e23b715b16f8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7322c0-56fb-4fe9-b790-9836a04cf8f9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPyJMfwG {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPyJMfwG" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[909850b3-ce65-403a-9e34-befacc0f9b91]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPyJMfwG'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6362504-e1b9-42a3-b54c-e706f4700aa1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2981098-6d80-4559-bc04-7984b6f39adb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e45dde-7581-489e-9ce6-c37006b8364a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260]
Aug 17 15:02:40 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260] successful.
Aug 17 15:02:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbe4e7c-efba-4876-bc35-a6cf005d6620]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e90bcc-31b4-4b72-9c60-04d21220072b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:02:40 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe09c1-e410-47dc-a1a4-11a533729d65]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:02:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-changed-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Refreshing instance network info cache due to event network-changed-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] Acquiring lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] Acquired lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Refreshing network info cache for port ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23734316137643462', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734316137643462', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-103246472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-103246472',id=39,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-gsqd8r9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:02:18Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=9c2a7315-c524-4c66-9018-9f760bc3f2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:02:41 user nova-compute[73079]:   <uuid>9c2a7315-c524-4c66-9018-9f760bc3f2b6</uuid>
Aug 17 15:02:41 user nova-compute[73079]:   <name>instance-00000027</name>
Aug 17 15:02:41 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:02:41 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:02:41 user nova-compute[73079]:   <metadata>
Aug 17 15:02:41 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:02:41 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:02:41 user nova-compute[73079]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-103246472</nova:name>
Aug 17 15:02:41 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:02:40</nova:creationTime>
Aug 17 15:02:41 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:02:41 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:02:41 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:02:41 user nova-compute[73079]:       <nova:owner>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:user uuid="5f67004af6654b5d80924a5c502a74f2">tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member</nova:user>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:project uuid="0edd4ad5f2eb4e728a71908d32d353d5">tempest-ServerBootFromVolumeStableRescueTest-2072772980</nova:project>
Aug 17 15:02:41 user nova-compute[73079]:       </nova:owner>
Aug 17 15:02:41 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:02:41 user nova-compute[73079]:       <nova:ports>
Aug 17 15:02:41 user nova-compute[73079]:         <nova:port uuid="162abcfd-c46e-45f8-b626-ff551ef3a40d">
Aug 17 15:02:41 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 15:02:41 user nova-compute[73079]:         </nova:port>
Aug 17 15:02:41 user nova-compute[73079]:       </nova:ports>
Aug 17 15:02:41 user nova-compute[73079]:     </nova:instance>
Aug 17 15:02:41 user nova-compute[73079]:   </metadata>
Aug 17 15:02:41 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:02:41 user nova-compute[73079]:     <system>
Aug 17 15:02:41 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:02:41 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:02:41 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:02:41 user nova-compute[73079]:       <entry name="serial">9c2a7315-c524-4c66-9018-9f760bc3f2b6</entry>
Aug 17 15:02:41 user nova-compute[73079]:       <entry name="uuid">9c2a7315-c524-4c66-9018-9f760bc3f2b6</entry>
Aug 17 15:02:41 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:02:41 user nova-compute[73079]:     </system>
Aug 17 15:02:41 user nova-compute[73079]:   </sysinfo>
Aug 17 15:02:41 user nova-compute[73079]:   <os>
Aug 17 15:02:41 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:02:41 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:02:41 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:02:41 user nova-compute[73079]:   </os>
Aug 17 15:02:41 user nova-compute[73079]:   <features>
Aug 17 15:02:41 user nova-compute[73079]:     <acpi/>
Aug 17 15:02:41 user nova-compute[73079]:     <apic/>
Aug 17 15:02:41 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:02:41 user nova-compute[73079]:   </features>
Aug 17 15:02:41 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:02:41 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:02:41 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:02:41 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:02:41 user nova-compute[73079]:   </clock>
Aug 17 15:02:41 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:02:41 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:02:41 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:02:41 user nova-compute[73079]:   </cpu>
Aug 17 15:02:41 user nova-compute[73079]:   <devices>
Aug 17 15:02:41 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:02:41 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:02:41 user nova-compute[73079]:       <source dev="/dev/sde"/>
Aug 17 15:02:41 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:02:41 user nova-compute[73079]:       <serial>38f9bf35-ed69-4781-9e55-b75e4fcfac69</serial>
Aug 17 15:02:41 user nova-compute[73079]:     </disk>
Aug 17 15:02:41 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:02:41 user nova-compute[73079]:       <mac address="fa:16:3e:39:e9:fe"/>
Aug 17 15:02:41 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:02:41 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:02:41 user nova-compute[73079]:       <target dev="tap162abcfd-c4"/>
Aug 17 15:02:41 user nova-compute[73079]:     </interface>
Aug 17 15:02:41 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:02:41 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/console.log" append="off"/>
Aug 17 15:02:41 user nova-compute[73079]:     </serial>
Aug 17 15:02:41 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:02:41 user nova-compute[73079]:     <video>
Aug 17 15:02:41 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:02:41 user nova-compute[73079]:     </video>
Aug 17 15:02:41 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:02:41 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:02:41 user nova-compute[73079]:     </rng>
Aug 17 15:02:41 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:02:41 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:02:41 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:02:41 user nova-compute[73079]:     </memballoon>
Aug 17 15:02:41 user nova-compute[73079]:   </devices>
Aug 17 15:02:41 user nova-compute[73079]: </domain>
Aug 17 15:02:41 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-103246472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-103246472',id=39,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-gsqd8r9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:02:18Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=9c2a7315-c524-4c66-9018-9f760bc3f2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG os_vif [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap162abcfd-c4, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap162abcfd-c4, col_values=(('external_ids', {'iface-id': '162abcfd-c46e-45f8-b626-ff551ef3a40d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:e9:fe', 'vm-uuid': '9c2a7315-c524-4c66-9018-9f760bc3f2b6'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:41 user nova-compute[73079]: INFO os_vif [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4')
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updated VIF entry in instance network info cache for port ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updating instance_info_cache with network_info: [{"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bc256fe4-6900-4101-a865-bfec9b1f17fe req-bbd329a9-3101-4792-a0be-d045086fceef service nova] Releasing lock "refresh_cache-11f131b9-b7a2-4020-a92a-4cc24bfc4d11" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:02:41 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No VIF found with MAC fa:16:3e:39:e9:fe, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284547.0748646, 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:02:42 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] VM Stopped (Lifecycle Event)
Aug 17 15:02:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5f3b5076-d045-42dd-817e-eeb42507656e None None] [instance: 7052d5fa-bc72-4f78-bd9d-0bcc29432ec5] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:42 user nova-compute[73079]: INFO nova.compute.manager [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Terminating instance
Aug 17 15:02:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-e16d0e04-d212-42e1-ac9e-957690ced79f req-001b790a-9b77-4d3d-9581-767132c35a23 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e16d0e04-d212-42e1-ac9e-957690ced79f req-001b790a-9b77-4d3d-9581-767132c35a23 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e16d0e04-d212-42e1-ac9e-957690ced79f req-001b790a-9b77-4d3d-9581-767132c35a23 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e16d0e04-d212-42e1-ac9e-957690ced79f req-001b790a-9b77-4d3d-9581-767132c35a23 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-e16d0e04-d212-42e1-ac9e-957690ced79f req-001b790a-9b77-4d3d-9581-767132c35a23 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:43 user nova-compute[73079]: WARNING nova.compute.manager [req-e16d0e04-d212-42e1-ac9e-957690ced79f req-001b790a-9b77-4d3d-9581-767132c35a23 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state building and task_state spawning.
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-09551c6a-693f-4600-bad4-7a14fa1e4d2d req-13d8cda0-c069-4b22-990e-cb0234a1d7f4 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-vif-unplugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09551c6a-693f-4600-bad4-7a14fa1e4d2d req-13d8cda0-c069-4b22-990e-cb0234a1d7f4 service nova] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09551c6a-693f-4600-bad4-7a14fa1e4d2d req-13d8cda0-c069-4b22-990e-cb0234a1d7f4 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09551c6a-693f-4600-bad4-7a14fa1e4d2d req-13d8cda0-c069-4b22-990e-cb0234a1d7f4 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-09551c6a-693f-4600-bad4-7a14fa1e4d2d req-13d8cda0-c069-4b22-990e-cb0234a1d7f4 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] No waiting events found dispatching network-vif-unplugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-09551c6a-693f-4600-bad4-7a14fa1e4d2d req-13d8cda0-c069-4b22-990e-cb0234a1d7f4 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-vif-unplugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Instance destroyed successfully.
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.objects.instance [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'resources' on Instance uuid 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-588160546',display_name='tempest-TestVolumeBootPattern-server-588160546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-588160546',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:01:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-lc10vagx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:01:05Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=11f131b9-b7a2-4020-a92a-4cc24bfc4d11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "address": "fa:16:3e:0d:f7:7e", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1bdd3c-10", "ovs_interfaceid": "ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_vif [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea1bdd3c-10, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:43 user nova-compute[73079]: INFO os_vif [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f7:7e,bridge_name='br-int',has_traffic_filtering=True,id=ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1bdd3c-10')
Aug 17 15:02:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:02:43 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f113f-b3ac-4b64-8628-b43dcb2bd07b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8214d-6f80-4471-aba1-53fa93166101]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:43 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:43 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:43 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:02:43 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:02:43 user nova-compute[73079]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:02:43 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:02:43 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:02:43 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e81bfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d28535-8072-47ca-b38d-4b181f21350f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbdc2ce-d257-4141-8540-9550faa4672f]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[322b1dc7-8508-455f-9746-b83c67fe2fa5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c717129-1569-46b3-890c-a6aa6ee1866d]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe1b940-e56ac1cf8e149691', '/dev/disk/by-id/scsi-26535366163316366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1b940') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d45185-cb20-49c4-8020-0f7d65ac0a2c]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc5a51-da4a-42ea-ac30-bf97c1f41582]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfce75f-dcd1-4a73-9dad-bb7ae780960a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]
Aug 17 15:02:43 user nova-compute[73079]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.
Aug 17 15:02:43 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387771a-1395-49df-8b5e-7084b0520957]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== disconnect_volume: return (338ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:02:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Deleting instance files /opt/stack/data/nova/instances/11f131b9-b7a2-4020-a92a-4cc24bfc4d11_del
Aug 17 15:02:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Deletion of /opt/stack/data/nova/instances/11f131b9-b7a2-4020-a92a-4cc24bfc4d11_del complete
Aug 17 15:02:44 user nova-compute[73079]: INFO nova.compute.manager [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 17 15:02:44 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:02:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Took 1.13 seconds to deallocate network for instance.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-d4b9176c-4163-42cf-aff9-e7cb5fc1348f req-bbb2e59b-d9dd-43cf-8dc8-d92af7005ceb service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-vif-deleted-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-fcd3b8e1-5f18-403f-8714-27d062814011 req-08dc6c8d-c97e-4a88-938f-ec3397a74ad2 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fcd3b8e1-5f18-403f-8714-27d062814011 req-08dc6c8d-c97e-4a88-938f-ec3397a74ad2 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fcd3b8e1-5f18-403f-8714-27d062814011 req-08dc6c8d-c97e-4a88-938f-ec3397a74ad2 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fcd3b8e1-5f18-403f-8714-27d062814011 req-08dc6c8d-c97e-4a88-938f-ec3397a74ad2 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-fcd3b8e1-5f18-403f-8714-27d062814011 req-08dc6c8d-c97e-4a88-938f-ec3397a74ad2 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:45 user nova-compute[73079]: WARNING nova.compute.manager [req-fcd3b8e1-5f18-403f-8714-27d062814011 req-08dc6c8d-c97e-4a88-938f-ec3397a74ad2 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state building and task_state spawning.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-37891adb-0f19-431b-bb2d-9f0a0e0ee2cb req-41e7681a-2d8e-417f-9555-d50cd53f0709 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received event network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-37891adb-0f19-431b-bb2d-9f0a0e0ee2cb req-41e7681a-2d8e-417f-9555-d50cd53f0709 service nova] Acquiring lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-37891adb-0f19-431b-bb2d-9f0a0e0ee2cb req-41e7681a-2d8e-417f-9555-d50cd53f0709 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-37891adb-0f19-431b-bb2d-9f0a0e0ee2cb req-41e7681a-2d8e-417f-9555-d50cd53f0709 service nova] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-37891adb-0f19-431b-bb2d-9f0a0e0ee2cb req-41e7681a-2d8e-417f-9555-d50cd53f0709 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] No waiting events found dispatching network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:02:45 user nova-compute[73079]: WARNING nova.compute.manager [req-37891adb-0f19-431b-bb2d-9f0a0e0ee2cb req-41e7681a-2d8e-417f-9555-d50cd53f0709 service nova] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Received unexpected event network-vif-plugged-ea1bdd3c-10ef-479f-a7ee-7fa23b8c9e50 for instance with vm_state active and task_state deleting.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284565.4905055, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Resumed (Lifecycle Event)
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance spawned successfully.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284565.492542, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Started (Lifecycle Event)
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:02:45 user nova-compute[73079]: INFO nova.compute.manager [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Took 28.54 seconds to build instance.
Aug 17 15:02:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3a8c2bd-a645-4a8c-b640-8bf0663b04a3 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.643s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:46 user nova-compute[73079]: INFO nova.compute.manager [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Took 0.90 seconds to detach 1 volumes for instance.
Aug 17 15:02:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:02:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:02:46 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:02:46 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:02:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:46 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Deleted allocations for instance 11f131b9-b7a2-4020-a92a-4cc24bfc4d11
Aug 17 15:02:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-65823ef4-f87b-49a9-a346-f24d40797ce6 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "11f131b9-b7a2-4020-a92a-4cc24bfc4d11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.916s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:02:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:58 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284563.610921, 11f131b9-b7a2-4020-a92a-4cc24bfc4d11 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:02:58 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] VM Stopped (Lifecycle Event)
Aug 17 15:02:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41921726-1156-4079-85c1-9947ddb57164 None None] [instance: 11f131b9-b7a2-4020-a92a-4cc24bfc4d11] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:02:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:02:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:04 user nova-compute[73079]: INFO nova.compute.manager [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Detaching volume b024e2c4-8568-4139-be83-b0258cd1e8b1
Aug 17 15:03:04 user nova-compute[73079]: INFO nova.virt.block_device [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Attempting to driver detach volume b024e2c4-8568-4139-be83-b0258cd1e8b1 from mountpoint /dev/vdb
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Attempting to detach device vdb from instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:03:04 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:03:04 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:03:04 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:03:04 user nova-compute[73079]:   <serial>b024e2c4-8568-4139-be83-b0258cd1e8b1</serial>
Aug 17 15:03:04 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:03:04 user nova-compute[73079]: </disk>
Aug 17 15:03:04 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:03:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully detached device vdb from instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 from the persistent domain config.
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:03:04 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:03:04 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:03:04 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:03:04 user nova-compute[73079]:   <serial>b024e2c4-8568-4139-be83-b0258cd1e8b1</serial>
Aug 17 15:03:04 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:03:04 user nova-compute[73079]: </disk>
Aug 17 15:03:04 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284584.7576041, 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:03:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully detached device vdb from instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 from the live domain config.
Aug 17 15:03:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMZiTXLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4876ff27-45a1-4b85-a117-6a3854f69a67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d47d33b-a5df-446f-86e8-23cb2eb5b991]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:04 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:03:04 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:04 user nova-compute[73079]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 (non-flash)
Aug 17 15:03:04 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e8544d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1557be-9f2e-4332-8545-d5e2f0e7125b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5afe338-98b8-45d9-9432-4e23faaa8501]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3909093-8db7-44e9-999d-fade3c793824]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a92f733-4b95-40b2-869a-6620f82bdb04]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2080881e-3bc8-4668-8f44-1bd946f6ff09]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2e4ac-bd26-4538-afa6-4542f6d2175f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260]
Aug 17 15:03:05 user nova-compute[73079]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1, portal: 172.16.0.220,3260] successful.
Aug 17 15:03:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbb792d-ed58-481b-958d-a924d88dac2a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== disconnect_volume: return (311ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:03:05 user nova-compute[73079]: INFO nova.compute.claims [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Claim successful on node user
Aug 17 15:03:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'flavor' on Instance uuid 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2bbf3a96-c286-4a5f-8ebb-1d68ad41c5aa tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.623s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:05 user nova-compute[73079]: INFO nova.compute.manager [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Terminating instance
Aug 17 15:03:05 user nova-compute[73079]: DEBUG nova.compute.manager [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:03:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.policy [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e045035e51f7437290769532c3190a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b096133b2342ffa84c7c60354e4b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c6ce251-ae6d-4de4-bb45-0395fd674208 req-9ee17609-3e40-4f6b-9c91-5930b8ae7c8d service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-vif-unplugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c6ce251-ae6d-4de4-bb45-0395fd674208 req-9ee17609-3e40-4f6b-9c91-5930b8ae7c8d service nova] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c6ce251-ae6d-4de4-bb45-0395fd674208 req-9ee17609-3e40-4f6b-9c91-5930b8ae7c8d service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6c6ce251-ae6d-4de4-bb45-0395fd674208 req-9ee17609-3e40-4f6b-9c91-5930b8ae7c8d service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c6ce251-ae6d-4de4-bb45-0395fd674208 req-9ee17609-3e40-4f6b-9c91-5930b8ae7c8d service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] No waiting events found dispatching network-vif-unplugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [req-6c6ce251-ae6d-4de4-bb45-0395fd674208 req-9ee17609-3e40-4f6b-9c91-5930b8ae7c8d service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-vif-unplugged-dd037561-804d-4905-a498-dc89d81555f3 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:03:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Creating image(s)
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "/opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "/opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "/opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Instance destroyed successfully.
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.objects.instance [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lazy-loading 'resources' on Instance uuid 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk 1073741824" returned: 0 in 0.053s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1160679597',display_name='tempest-VolumesSnapshotTestJSON-instance-1160679597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1160679597',id=36,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQXzy6Ow/EpSeuygFukkrZwp6P1s/99kO2ISGikaqcvIShDj7749ZeH20YEkjyXFmlGZUGo+Oj95kHRji6BwbfRcYsG+k90JRjNkvESU9UY9OlYR/KoSaNS+uCKJc7c/w==',key_name='tempest-keypair-154458942',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:00:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44793ff31d0044ed921e6d2ab2f95e02',ramdisk_id='',reservation_id='r-pmaugcbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2084510521',owner_user_name='tempest-VolumesSnapshotTestJSON-2084510521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='735852ace093495aaf816e6cad97d813',uuid=5c0eb7ca-8ef7-4193-8cf9-d051dceebae7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converting VIF {"id": "dd037561-804d-4905-a498-dc89d81555f3", "address": "fa:16:3e:e1:f2:64", "network": {"id": "456b2c2d-8969-4432-9419-bd34cfff57a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749083796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44793ff31d0044ed921e6d2ab2f95e02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd037561-80", "ovs_interfaceid": "dd037561-804d-4905-a498-dc89d81555f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_vif [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd037561-80, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:03:06 user nova-compute[73079]: INFO os_vif [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f2:64,bridge_name='br-int',has_traffic_filtering=True,id=dd037561-804d-4905-a498-dc89d81555f3,network=Network(456b2c2d-8969-4432-9419-bd34cfff57a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd037561-80')
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMZiTXLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:06 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024e2c4-8568-4139-be83-b0258cd1e8b1', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb1e906-2bcd-4a74-8b14-f714a16252c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.network.neutron [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Successfully created port: be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5eda0-a241-43b3-a670-0462127a58c4]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:06 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:06 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:06 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:06 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e83df910>, {}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Disconnecting from: [] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] <== disconnect_volume: return (56ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:03:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Deleting instance files /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7_del
Aug 17 15:03:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Deletion of /opt/stack/data/nova/instances/5c0eb7ca-8ef7-4193-8cf9-d051dceebae7_del complete
Aug 17 15:03:06 user nova-compute[73079]: INFO nova.compute.manager [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.209s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:03:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Cannot resize image /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG nova.objects.instance [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lazy-loading 'migration_context' on Instance uuid 25703282-9d49-42a3-9eb5-1f22de3b388b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Ensure instance console log exists: /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:08 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Took 1.39 seconds to deallocate network for instance.
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-f05bd667-2e32-43d0-b898-e1be4c539d65 req-e2b1fb6f-64ff-4c5e-8092-55a30633e3f8 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f05bd667-2e32-43d0-b898-e1be4c539d65 req-e2b1fb6f-64ff-4c5e-8092-55a30633e3f8 service nova] Acquiring lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f05bd667-2e32-43d0-b898-e1be4c539d65 req-e2b1fb6f-64ff-4c5e-8092-55a30633e3f8 service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f05bd667-2e32-43d0-b898-e1be4c539d65 req-e2b1fb6f-64ff-4c5e-8092-55a30633e3f8 service nova] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-f05bd667-2e32-43d0-b898-e1be4c539d65 req-e2b1fb6f-64ff-4c5e-8092-55a30633e3f8 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] No waiting events found dispatching network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:08 user nova-compute[73079]: WARNING nova.compute.manager [req-f05bd667-2e32-43d0-b898-e1be4c539d65 req-e2b1fb6f-64ff-4c5e-8092-55a30633e3f8 service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received unexpected event network-vif-plugged-dd037561-804d-4905-a498-dc89d81555f3 for instance with vm_state active and task_state deleting.
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-188cd51c-0cec-4132-83c3-51c608ae2885 req-096bccb2-3ba6-4992-8d9b-1aa020cd032d service nova] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Received event network-vif-deleted-dd037561-804d-4905-a498-dc89d81555f3 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:08 user nova-compute[73079]: WARNING nova.volume.cinder [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Attachment 8ddfff90-fae0-40a7-a2cc-b46f9ebfbd50 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8ddfff90-fae0-40a7-a2cc-b46f9ebfbd50. (HTTP 404) (Request-ID: req-b0189366-196f-4f1a-ad20-c044dcc1e812)
Aug 17 15:03:08 user nova-compute[73079]: INFO nova.compute.manager [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Successfully updated port: be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "refresh_cache-25703282-9d49-42a3-9eb5-1f22de3b388b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquired lock "refresh_cache-25703282-9d49-42a3-9eb5-1f22de3b388b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:08 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Deleted allocations for instance 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Updating instance_info_cache with network_info: [{"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-af7e4d39-a295-41b4-8fbd-7730f20cf1bb tempest-VolumesSnapshotTestJSON-2084510521 tempest-VolumesSnapshotTestJSON-2084510521-project-member] Lock "5c0eb7ca-8ef7-4193-8cf9-d051dceebae7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Releasing lock "refresh_cache-25703282-9d49-42a3-9eb5-1f22de3b388b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Instance network_info: |[{"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Start _get_guest_xml network_info=[{"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:03:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:03:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-245797924',display_name='tempest-VolumesActionsTest-instance-245797924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-245797924',id=40,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87b096133b2342ffa84c7c60354e4b2c',ramdisk_id='',reservation_id='r-ag7ki0f9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1667820847',owner_user_name='tempest-VolumesActionsTest-1667820847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:03:06Z,user_data=None,user_id='e045035e51f7437290769532c3190a5f',uuid=25703282-9d49-42a3-9eb5-1f22de3b388b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converting VIF {"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.objects.instance [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lazy-loading 'pci_devices' on Instance uuid 25703282-9d49-42a3-9eb5-1f22de3b388b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:03:08 user nova-compute[73079]:   <uuid>25703282-9d49-42a3-9eb5-1f22de3b388b</uuid>
Aug 17 15:03:08 user nova-compute[73079]:   <name>instance-00000028</name>
Aug 17 15:03:08 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:03:08 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:03:08 user nova-compute[73079]:   <metadata>
Aug 17 15:03:08 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:03:08 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:03:08 user nova-compute[73079]:       <nova:name>tempest-VolumesActionsTest-instance-245797924</nova:name>
Aug 17 15:03:08 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:03:08</nova:creationTime>
Aug 17 15:03:08 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:03:08 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:03:08 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:03:08 user nova-compute[73079]:       <nova:owner>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:user uuid="e045035e51f7437290769532c3190a5f">tempest-VolumesActionsTest-1667820847-project-member</nova:user>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:project uuid="87b096133b2342ffa84c7c60354e4b2c">tempest-VolumesActionsTest-1667820847</nova:project>
Aug 17 15:03:08 user nova-compute[73079]:       </nova:owner>
Aug 17 15:03:08 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:03:08 user nova-compute[73079]:       <nova:ports>
Aug 17 15:03:08 user nova-compute[73079]:         <nova:port uuid="be3de91e-62d1-457a-97c4-322ab3879385">
Aug 17 15:03:08 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:03:08 user nova-compute[73079]:         </nova:port>
Aug 17 15:03:08 user nova-compute[73079]:       </nova:ports>
Aug 17 15:03:08 user nova-compute[73079]:     </nova:instance>
Aug 17 15:03:08 user nova-compute[73079]:   </metadata>
Aug 17 15:03:08 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:03:08 user nova-compute[73079]:     <system>
Aug 17 15:03:08 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:03:08 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:03:08 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:03:08 user nova-compute[73079]:       <entry name="serial">25703282-9d49-42a3-9eb5-1f22de3b388b</entry>
Aug 17 15:03:08 user nova-compute[73079]:       <entry name="uuid">25703282-9d49-42a3-9eb5-1f22de3b388b</entry>
Aug 17 15:03:08 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:03:08 user nova-compute[73079]:     </system>
Aug 17 15:03:08 user nova-compute[73079]:   </sysinfo>
Aug 17 15:03:08 user nova-compute[73079]:   <os>
Aug 17 15:03:08 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:03:08 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:03:08 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:03:08 user nova-compute[73079]:   </os>
Aug 17 15:03:08 user nova-compute[73079]:   <features>
Aug 17 15:03:08 user nova-compute[73079]:     <acpi/>
Aug 17 15:03:08 user nova-compute[73079]:     <apic/>
Aug 17 15:03:08 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:03:08 user nova-compute[73079]:   </features>
Aug 17 15:03:08 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:03:08 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:03:08 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:03:08 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:03:08 user nova-compute[73079]:   </clock>
Aug 17 15:03:08 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:03:08 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:03:08 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:03:08 user nova-compute[73079]:   </cpu>
Aug 17 15:03:08 user nova-compute[73079]:   <devices>
Aug 17 15:03:08 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:03:08 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:03:08 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk"/>
Aug 17 15:03:08 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:03:08 user nova-compute[73079]:     </disk>
Aug 17 15:03:08 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:03:08 user nova-compute[73079]:       <mac address="fa:16:3e:b7:29:56"/>
Aug 17 15:03:08 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:03:08 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:03:08 user nova-compute[73079]:       <target dev="tapbe3de91e-62"/>
Aug 17 15:03:08 user nova-compute[73079]:     </interface>
Aug 17 15:03:08 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:03:08 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/console.log" append="off"/>
Aug 17 15:03:08 user nova-compute[73079]:     </serial>
Aug 17 15:03:08 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:03:08 user nova-compute[73079]:     <video>
Aug 17 15:03:08 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:03:08 user nova-compute[73079]:     </video>
Aug 17 15:03:08 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:03:08 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:03:08 user nova-compute[73079]:     </rng>
Aug 17 15:03:08 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:03:08 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:03:08 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:03:08 user nova-compute[73079]:     </memballoon>
Aug 17 15:03:08 user nova-compute[73079]:   </devices>
Aug 17 15:03:08 user nova-compute[73079]: </domain>
Aug 17 15:03:08 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-245797924',display_name='tempest-VolumesActionsTest-instance-245797924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-245797924',id=40,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87b096133b2342ffa84c7c60354e4b2c',ramdisk_id='',reservation_id='r-ag7ki0f9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1667820847',owner_user_name='tempest-VolumesActionsTest-1667820847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:03:06Z,user_data=None,user_id='e045035e51f7437290769532c3190a5f',uuid=25703282-9d49-42a3-9eb5-1f22de3b388b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converting VIF {"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG os_vif [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe3de91e-62, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe3de91e-62, col_values=(('external_ids', {'iface-id': 'be3de91e-62d1-457a-97c4-322ab3879385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:29:56', 'vm-uuid': '25703282-9d49-42a3-9eb5-1f22de3b388b'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:03:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:08 user nova-compute[73079]: INFO os_vif [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62')
Aug 17 15:03:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:03:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] No VIF found with MAC fa:16:3e:b7:29:56, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-changed-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Refreshing instance network info cache due to event network-changed-be3de91e-62d1-457a-97c4-322ab3879385. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] Acquiring lock "refresh_cache-25703282-9d49-42a3-9eb5-1f22de3b388b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] Acquired lock "refresh_cache-25703282-9d49-42a3-9eb5-1f22de3b388b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.network.neutron [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Refreshing network info cache for port be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-b77204e5-fd66-4c7a-ae68-a8bcdfe2e505 req-e4b3c2c0-6209-4ee2-91fb-644737679ee8 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b77204e5-fd66-4c7a-ae68-a8bcdfe2e505 req-e4b3c2c0-6209-4ee2-91fb-644737679ee8 service nova] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b77204e5-fd66-4c7a-ae68-a8bcdfe2e505 req-e4b3c2c0-6209-4ee2-91fb-644737679ee8 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b77204e5-fd66-4c7a-ae68-a8bcdfe2e505 req-e4b3c2c0-6209-4ee2-91fb-644737679ee8 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-b77204e5-fd66-4c7a-ae68-a8bcdfe2e505 req-e4b3c2c0-6209-4ee2-91fb-644737679ee8 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] No waiting events found dispatching network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:10 user nova-compute[73079]: WARNING nova.compute.manager [req-b77204e5-fd66-4c7a-ae68-a8bcdfe2e505 req-e4b3c2c0-6209-4ee2-91fb-644737679ee8 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received unexpected event network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 for instance with vm_state building and task_state spawning.
Aug 17 15:03:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.network.neutron [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Updated VIF entry in instance network info cache for port be3de91e-62d1-457a-97c4-322ab3879385. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG nova.network.neutron [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Updating instance_info_cache with network_info: [{"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-34c88b97-1b2b-4993-b8c2-349f3f944560 req-727ffb2d-b182-48e9-8f29-68cf273df11a service nova] Releasing lock "refresh_cache-25703282-9d49-42a3-9eb5-1f22de3b388b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284592.4885054, 25703282-9d49-42a3-9eb5-1f22de3b388b => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] VM Resumed (Lifecycle Event)
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Instance spawned successfully.
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284592.4901896, 25703282-9d49-42a3-9eb5-1f22de3b388b => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] VM Started (Lifecycle Event)
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fa1405b-1615-49e5-9493-911e95236893 req-a0340792-f25d-4e45-9af7-5808e18ed563 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fa1405b-1615-49e5-9493-911e95236893 req-a0340792-f25d-4e45-9af7-5808e18ed563 service nova] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fa1405b-1615-49e5-9493-911e95236893 req-a0340792-f25d-4e45-9af7-5808e18ed563 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3fa1405b-1615-49e5-9493-911e95236893 req-a0340792-f25d-4e45-9af7-5808e18ed563 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-3fa1405b-1615-49e5-9493-911e95236893 req-a0340792-f25d-4e45-9af7-5808e18ed563 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] No waiting events found dispatching network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:12 user nova-compute[73079]: WARNING nova.compute.manager [req-3fa1405b-1615-49e5-9493-911e95236893 req-a0340792-f25d-4e45-9af7-5808e18ed563 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received unexpected event network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 for instance with vm_state building and task_state spawning.
Aug 17 15:03:12 user nova-compute[73079]: INFO nova.compute.manager [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Took 6.94 seconds to build instance.
Aug 17 15:03:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-cc0c4e9c-8bb3-4a8a-810d-99e0d04c4e59 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.049s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:03:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:03:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284586.7408526, 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:03:22 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] VM Stopped (Lifecycle Event)
Aug 17 15:03:22 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:03:22 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7932MB free_disk=25.230831146240234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-140dd434-4f9e-48aa-8ef6-85575b8a0331 None None] [instance: 5c0eb7ca-8ef7-4193-8cf9-d051dceebae7] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b7fce05e-80ca-4a0f-950c-3c0933e5531a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 25703282-9d49-42a3-9eb5-1f22de3b388b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:03:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:03:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:03:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:03:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:03:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:03:24 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updating instance_info_cache with network_info: [{"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:03:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:03:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:03:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:03:34 user nova-compute[73079]: INFO nova.compute.claims [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Claim successful on node user
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:03:34 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:03:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:03:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:03:35 user nova-compute[73079]: INFO nova.virt.block_device [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Booting with volume 7680a124-ef70-4f8c-8b3f-fd9cc24f42fa at /dev/vda
Aug 17 15:03:35 user nova-compute[73079]: DEBUG nova.policy [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '722f38129c96487b8331cde0ab317832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9478b753e2040e799f28e18c5a82223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG os_brick.utils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d7ea6-adc8-4e4d-8baa-7e19983821ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6bf44b-28af-48d9-905e-c4767f7a5823]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef697192-e01e-49ef-85ae-9990a5d92b11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc976b86-7d49-4243-ab02-0b5ac21ecbf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:03:35 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:03:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9b99cf-7bbf-4dba-b5c8-10971da83b60]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG os_brick.utils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updating existing volume attachment record: 3caaaded-37b9-40f4-bf3a-16fc9153424b {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:03:35 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Successfully created port: 27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Successfully updated port: 27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquired lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-changed-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Refreshing instance network info cache due to event network-changed-27f04f18-ee2a-470f-91cb-9e8a7540def1. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] Acquiring lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:03:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updating instance_info_cache with network_info: [{"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Releasing lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Instance network_info: |[{"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] Acquired lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Refreshing network info cache for port 27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updated VIF entry in instance network info cache for port 27f04f18-ee2a-470f-91cb-9e8a7540def1. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updating instance_info_cache with network_info: [{"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3e3d291e-05a6-4afb-8829-bb2ac5e3a56c req-c1039326-8f23-4354-9df8-11c3653b5ccf service nova] Releasing lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:03:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-changed-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Refreshing instance network info cache due to event network-changed-bd8b26ce-779d-4b58-98af-15a67ac1373d. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:03:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] Acquiring lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:03:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] Acquired lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:03:38 user nova-compute[73079]: DEBUG nova.network.neutron [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Refreshing network info cache for port bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:03:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:39 user nova-compute[73079]: DEBUG nova.network.neutron [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updated VIF entry in instance network info cache for port bd8b26ce-779d-4b58-98af-15a67ac1373d. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:03:39 user nova-compute[73079]: DEBUG nova.network.neutron [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updating instance_info_cache with network_info: [{"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:03:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3cbd9835-b656-4dd6-b735-994883283a67 req-2b93c867-48d5-4914-8a2a-95a00027d328 service nova] Releasing lock "refresh_cache-b7fce05e-80ca-4a0f-950c-3c0933e5531a" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'flavor' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:40 user nova-compute[73079]: INFO nova.compute.manager [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attaching volume 2318988b-ea08-456f-8ef9-2fe1fec1d27e to /dev/vdb
Aug 17 15:03:40 user nova-compute[73079]: DEBUG os_brick.utils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d005d-2cd1-4150-9cab-c7317196e2a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e937ab-e09a-4124-80cb-59687f7388f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba264b6-f039-48c8-8c69-206b32d7d7b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0d9c0-20fc-4d2e-8587-966842e2f5df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:03:40 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:03:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1654ff74-c59a-408d-92ea-b2d1d44506ea]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG os_brick.utils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:40 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updating existing volume attachment record: b11ba5d2-5a5e-4de2-bb24-d79e1dc276ee {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:03:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:03:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Creating image(s)
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Ensure instance console log exists: /opt/stack/data/nova/instances/0693416d-2ee8-4847-9249-ee10d085b3aa/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Start _get_guest_xml network_info=[{"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '3caaaded-37b9-40f4-bf3a-16fc9153424b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0693416d-2ee8-4847-9249-ee10d085b3aa', 'attached_at': '', 'detached_at': '', 'volume_id': '7680a124-ef70-4f8c-8b3f-fd9cc24f42fa', 'serial': '7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:03:46 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:03:46 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:46 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0120ad-c348-4346-ab86-894b0ad7acac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:03:46 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746f27c-c054-47a4-91b0-713c53570515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa] added
Aug 17 15:03:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ec588-64e2-430d-8868-0e76f5bf7191]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[db933c9d-3843-432b-b143-e16ad6e15ddd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fCalKBXP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fCalKBXP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8cf223-4160-4bff-b852-27563349ece5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fCalKBXP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf10493-887c-44a8-87fd-f3cb5cf25c90]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ffdf82-8d69-4930-ac12-0a90ca7aebfa]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bde6e0-6363-4933-b73e-65da459cbb90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]
Aug 17 15:03:46 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.
Aug 17 15:03:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d97e8e-2373-467c-b8d8-adda533bff06]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a784ed1d-b97b-489b-a503-26fad66aa1d5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:46 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5a7db-3fa7-4263-ab92-a05b8939648e]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:03:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26535366163316366', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535366163316366', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-931083762',display_name='tempest-TestVolumeBootPattern-server-931083762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-931083762',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-aghn2lc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:03:35Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=0693416d-2ee8-4847-9249-ee10d085b3aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'pci_devices' on Instance uuid 0693416d-2ee8-4847-9249-ee10d085b3aa {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:03:47 user nova-compute[73079]:   <uuid>0693416d-2ee8-4847-9249-ee10d085b3aa</uuid>
Aug 17 15:03:47 user nova-compute[73079]:   <name>instance-00000029</name>
Aug 17 15:03:47 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:03:47 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:03:47 user nova-compute[73079]:   <metadata>
Aug 17 15:03:47 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:03:47 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:03:47 user nova-compute[73079]:       <nova:name>tempest-TestVolumeBootPattern-server-931083762</nova:name>
Aug 17 15:03:47 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:03:46</nova:creationTime>
Aug 17 15:03:47 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:03:47 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:03:47 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:03:47 user nova-compute[73079]:       <nova:owner>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:user uuid="722f38129c96487b8331cde0ab317832">tempest-TestVolumeBootPattern-1112851866-project-member</nova:user>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:project uuid="c9478b753e2040e799f28e18c5a82223">tempest-TestVolumeBootPattern-1112851866</nova:project>
Aug 17 15:03:47 user nova-compute[73079]:       </nova:owner>
Aug 17 15:03:47 user nova-compute[73079]:       <nova:ports>
Aug 17 15:03:47 user nova-compute[73079]:         <nova:port uuid="27f04f18-ee2a-470f-91cb-9e8a7540def1">
Aug 17 15:03:47 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:03:47 user nova-compute[73079]:         </nova:port>
Aug 17 15:03:47 user nova-compute[73079]:       </nova:ports>
Aug 17 15:03:47 user nova-compute[73079]:     </nova:instance>
Aug 17 15:03:47 user nova-compute[73079]:   </metadata>
Aug 17 15:03:47 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:03:47 user nova-compute[73079]:     <system>
Aug 17 15:03:47 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:03:47 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:03:47 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:03:47 user nova-compute[73079]:       <entry name="serial">0693416d-2ee8-4847-9249-ee10d085b3aa</entry>
Aug 17 15:03:47 user nova-compute[73079]:       <entry name="uuid">0693416d-2ee8-4847-9249-ee10d085b3aa</entry>
Aug 17 15:03:47 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:03:47 user nova-compute[73079]:     </system>
Aug 17 15:03:47 user nova-compute[73079]:   </sysinfo>
Aug 17 15:03:47 user nova-compute[73079]:   <os>
Aug 17 15:03:47 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:03:47 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:03:47 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:03:47 user nova-compute[73079]:   </os>
Aug 17 15:03:47 user nova-compute[73079]:   <features>
Aug 17 15:03:47 user nova-compute[73079]:     <acpi/>
Aug 17 15:03:47 user nova-compute[73079]:     <apic/>
Aug 17 15:03:47 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:03:47 user nova-compute[73079]:   </features>
Aug 17 15:03:47 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:03:47 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:03:47 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:03:47 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:03:47 user nova-compute[73079]:   </clock>
Aug 17 15:03:47 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:03:47 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:03:47 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:03:47 user nova-compute[73079]:   </cpu>
Aug 17 15:03:47 user nova-compute[73079]:   <devices>
Aug 17 15:03:47 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:03:47 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:03:47 user nova-compute[73079]:       <source dev="/dev/sdc"/>
Aug 17 15:03:47 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:03:47 user nova-compute[73079]:       <serial>7680a124-ef70-4f8c-8b3f-fd9cc24f42fa</serial>
Aug 17 15:03:47 user nova-compute[73079]:     </disk>
Aug 17 15:03:47 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:03:47 user nova-compute[73079]:       <mac address="fa:16:3e:39:f6:c8"/>
Aug 17 15:03:47 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:03:47 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:03:47 user nova-compute[73079]:       <target dev="tap27f04f18-ee"/>
Aug 17 15:03:47 user nova-compute[73079]:     </interface>
Aug 17 15:03:47 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:03:47 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/0693416d-2ee8-4847-9249-ee10d085b3aa/console.log" append="off"/>
Aug 17 15:03:47 user nova-compute[73079]:     </serial>
Aug 17 15:03:47 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:03:47 user nova-compute[73079]:     <video>
Aug 17 15:03:47 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:03:47 user nova-compute[73079]:     </video>
Aug 17 15:03:47 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:03:47 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:03:47 user nova-compute[73079]:     </rng>
Aug 17 15:03:47 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:03:47 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:03:47 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:03:47 user nova-compute[73079]:     </memballoon>
Aug 17 15:03:47 user nova-compute[73079]:   </devices>
Aug 17 15:03:47 user nova-compute[73079]: </domain>
Aug 17 15:03:47 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-931083762',display_name='tempest-TestVolumeBootPattern-server-931083762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-931083762',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-aghn2lc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:03:35Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=0693416d-2ee8-4847-9249-ee10d085b3aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG os_vif [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27f04f18-ee, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27f04f18-ee, col_values=(('external_ids', {'iface-id': '27f04f18-ee2a-470f-91cb-9e8a7540def1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:f6:c8', 'vm-uuid': '0693416d-2ee8-4847-9249-ee10d085b3aa'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:47 user nova-compute[73079]: INFO os_vif [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee')
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:03:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No VIF found with MAC fa:16:3e:39:f6:c8, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-033e5b8e-b6cd-4089-abb5-cb7e29cd64e0 req-0263c31f-14f4-44ab-a835-56a55b7380ca service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-033e5b8e-b6cd-4089-abb5-cb7e29cd64e0 req-0263c31f-14f4-44ab-a835-56a55b7380ca service nova] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-033e5b8e-b6cd-4089-abb5-cb7e29cd64e0 req-0263c31f-14f4-44ab-a835-56a55b7380ca service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-033e5b8e-b6cd-4089-abb5-cb7e29cd64e0 req-0263c31f-14f4-44ab-a835-56a55b7380ca service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-033e5b8e-b6cd-4089-abb5-cb7e29cd64e0 req-0263c31f-14f4-44ab-a835-56a55b7380ca service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] No waiting events found dispatching network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:49 user nova-compute[73079]: WARNING nova.compute.manager [req-033e5b8e-b6cd-4089-abb5-cb7e29cd64e0 req-0263c31f-14f4-44ab-a835-56a55b7380ca service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received unexpected event network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 for instance with vm_state building and task_state spawning.
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284631.3431056, 0693416d-2ee8-4847-9249-ee10d085b3aa => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] VM Resumed (Lifecycle Event)
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Instance spawned successfully.
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284631.3460991, 0693416d-2ee8-4847-9249-ee10d085b3aa => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] VM Started (Lifecycle Event)
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-9bb82cec-dde1-4579-9e5c-d0b33ce85d4b req-317124fe-3893-4f22-b3ad-dba909e8e352 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9bb82cec-dde1-4579-9e5c-d0b33ce85d4b req-317124fe-3893-4f22-b3ad-dba909e8e352 service nova] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9bb82cec-dde1-4579-9e5c-d0b33ce85d4b req-317124fe-3893-4f22-b3ad-dba909e8e352 service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9bb82cec-dde1-4579-9e5c-d0b33ce85d4b req-317124fe-3893-4f22-b3ad-dba909e8e352 service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-9bb82cec-dde1-4579-9e5c-d0b33ce85d4b req-317124fe-3893-4f22-b3ad-dba909e8e352 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] No waiting events found dispatching network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:51 user nova-compute[73079]: WARNING nova.compute.manager [req-9bb82cec-dde1-4579-9e5c-d0b33ce85d4b req-317124fe-3893-4f22-b3ad-dba909e8e352 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received unexpected event network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 for instance with vm_state building and task_state spawning.
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:51 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:51 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:51 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Took 5.15 seconds to spawn the instance on the hypervisor.
Aug 17 15:03:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850a64f-fb2d-48f7-a0e7-056a0de9512d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:03:51 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b74026-8099-4eee-89f1-d193ca0612c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e] added
Aug 17 15:03:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.070s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d3fa0-f69a-4184-8975-b253c4cf1814]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed837b-4701-48b6-896d-92acc7c0dd12]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlfaFCTZ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: INFO nova.compute.manager [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Took 17.05 seconds to build instance.
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlfaFCTZ" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[431892b4-42b6-453b-a1c6-35a4212d0bc5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wlfaFCTZ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4e778ed0-7945-474b-89f9-ebfd889e6db3 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.155s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[54edefac-540f-44f1-9775-9d733cbcdc45]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb6d88-902b-4f31-8060-5f74ce673a8d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19802f-75ba-41db-bd20-755447f90c9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]
Aug 17 15:03:51 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.
Aug 17 15:03:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c42a94-fffc-4846-b213-b921bb1c067e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.155s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e202269e-6474-41d7-9df6-a537c23df4f2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:03:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:51 user nova-compute[73079]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:03:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9162e180-5dff-45aa-8010-52c3661da12c]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:03:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23437633766666634', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633766666634', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'flavor' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:03:52 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:03:52 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:03:52 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:03:52 user nova-compute[73079]:   <serial>2318988b-ea08-456f-8ef9-2fe1fec1d27e</serial>
Aug 17 15:03:52 user nova-compute[73079]: </disk>
Aug 17 15:03:52 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:03:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:03:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:03:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No VIF found with MAC fa:16:3e:0b:c6:57, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:03:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a721be20-fa12-4acb-a0c9-e78ec3a057bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.251s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:54 user nova-compute[73079]: INFO nova.compute.manager [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Rebuilding instance
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_requests' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_devices' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'resources' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'migration_context' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73079) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-e6d44319-f735-4d1b-85dc-b414804c7d23 req-a2915cfe-52e7-45a6-9b78-10a360bc681b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e6d44319-f735-4d1b-85dc-b414804c7d23 req-a2915cfe-52e7-45a6-9b78-10a360bc681b service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e6d44319-f735-4d1b-85dc-b414804c7d23 req-a2915cfe-52e7-45a6-9b78-10a360bc681b service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e6d44319-f735-4d1b-85dc-b414804c7d23 req-a2915cfe-52e7-45a6-9b78-10a360bc681b service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-e6d44319-f735-4d1b-85dc-b414804c7d23 req-a2915cfe-52e7-45a6-9b78-10a360bc681b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:55 user nova-compute[73079]: WARNING nova.compute.manager [req-e6d44319-f735-4d1b-85dc-b414804c7d23 req-a2915cfe-52e7-45a6-9b78-10a360bc681b service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuilding.
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance destroyed successfully.
Aug 17 15:03:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: INFO nova.compute.manager [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Detaching volume 2318988b-ea08-456f-8ef9-2fe1fec1d27e
Aug 17 15:03:56 user nova-compute[73079]: INFO nova.virt.block_device [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attempting to driver detach volume 2318988b-ea08-456f-8ef9-2fe1fec1d27e from mountpoint /dev/vdb
Aug 17 15:03:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Attempting to detach device vdb from instance b7fce05e-80ca-4a0f-950c-3c0933e5531a from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:03:56 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:03:56 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:03:56 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:03:56 user nova-compute[73079]:   <serial>2318988b-ea08-456f-8ef9-2fe1fec1d27e</serial>
Aug 17 15:03:56 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:03:56 user nova-compute[73079]: </disk>
Aug 17 15:03:56 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully detached device vdb from instance b7fce05e-80ca-4a0f-950c-3c0933e5531a from the persistent domain config.
Aug 17 15:03:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:03:56 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884f8c5-218d-48be-849a-c99c21fb6b9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108e0b9-4b93-4080-9ddf-d7ee29be3574]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:56 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:56 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:56 user nova-compute[73079]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:03:56 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:03:56 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:03:56 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:03:56 user nova-compute[73079]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:03:56 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82f12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8a399-c66c-4d86-8f91-4d854d37df8e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b8b06-d06e-4c10-9a3d-8aeaf4d61b81]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e3356-6fdc-4027-97f8-c8c500a2cf97]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae3c9a-fdb6-44dc-9202-0d9e02d9a1f8]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a44eec-a790-439e-a819-e3142044b411]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6e0d7-b63c-428e-8e45-7c411849973a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]
Aug 17 15:03:56 user nova-compute[73079]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.
Aug 17 15:03:56 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457b25b-084b-45fa-b198-a2594e9eaea3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== disconnect_volume: return (319ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:03:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:57 user nova-compute[73079]: WARNING nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuilding.
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:57 user nova-compute[73079]: WARNING nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuilding.
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:57 user nova-compute[73079]: WARNING nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuilding.
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:57 user nova-compute[73079]: WARNING nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuilding.
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:03:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:03:57 user nova-compute[73079]: WARNING nova.compute.manager [req-7acfdbd0-61fc-44ff-afa5-d1ac721b742a req-7c995568-6067-4ee3-bf1d-e96d54e43376 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuilding.
Aug 17 15:03:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance destroyed successfully.
Aug 17 15:04:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1172900661',display_name='tempest-ServerActionsTestOtherA-server-1424658385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1172900661',id=38,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX+AAtt4TkrBADqts0gHca3h7/0Z3/nMtYXzIkLvV367jDT+K3GZ9xwHFbrS82LunQOYn68jsDE2hEwj7rYxOxBwjRbLJP1WBFakRnUTWIyzJ4fXBInNNvIWj2q92INqA==',key_name='tempest-keypair-2084706945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:01:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-r80y8dew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=b7fce05e-80ca-4a0f-950c-3c0933e5531a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd8b26ce-77, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:04:00 user nova-compute[73079]: INFO os_vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77')
Aug 17 15:04:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:04:00 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c6ea8-35c0-4692-a00a-bf0de73e1f3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8987e002-1659-4a48-9345-ea39a395fc91]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:00 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:00 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:00 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:00 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82fc940>, {}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Disconnecting from: [] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== disconnect_volume: return (58ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:04:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Deleting instance files /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a_del
Aug 17 15:04:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Deletion of /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a_del complete
Aug 17 15:04:00 user nova-compute[73079]: INFO nova.virt.block_device [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Booting with volume 2318988b-ea08-456f-8ef9-2fe1fec1d27e at /dev/vdb
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.utils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5899ee-d7db-455d-803b-8820c7873626]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab52ac-0acd-4a66-b29f-e61e64ea5cf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acab0cd-fb53-49cd-af84-2190d922f4e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c963e272-3b9a-4ad0-9b36-15386ac038f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:04:00 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:04:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58a93eb-1a79-4cb7-90b9-d65b11a4b6eb]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG os_brick.utils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:04:00 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updating existing volume attachment record: 10af9088-0d30-49e3-8ced-c6747a3b0a81 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:04:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:08 user nova-compute[73079]: INFO nova.compute.manager [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Rescuing
Aug 17 15:04:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating instance_info_cache with network_info: [{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-85e5789b-b9cd-4e27-821a-45077bd47b1a req-3383f5b5-74f9-45c1-874d-c2ddae1d36f6 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-85e5789b-b9cd-4e27-821a-45077bd47b1a req-3383f5b5-74f9-45c1-874d-c2ddae1d36f6 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-85e5789b-b9cd-4e27-821a-45077bd47b1a req-3383f5b5-74f9-45c1-874d-c2ddae1d36f6 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-85e5789b-b9cd-4e27-821a-45077bd47b1a req-3383f5b5-74f9-45c1-874d-c2ddae1d36f6 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-85e5789b-b9cd-4e27-821a-45077bd47b1a req-3383f5b5-74f9-45c1-874d-c2ddae1d36f6 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:09 user nova-compute[73079]: WARNING nova.compute.manager [req-85e5789b-b9cd-4e27-821a-45077bd47b1a req-3383f5b5-74f9-45c1-874d-c2ddae1d36f6 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state active and task_state rescuing.
Aug 17 15:04:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance destroyed successfully.
Aug 17 15:04:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Attempting a stable device rescue
Aug 17 15:04:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73079) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 15:04:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Creating image(s)
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "/opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "7b12f72ddd6f8947a9377dd1d174208a0a4dc307" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "7b12f72ddd6f8947a9377dd1d174208a0a4dc307" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:10 user nova-compute[73079]: DEBUG nova.virt.images [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] 27b67725-e61a-486a-b422-ff4fc7acc8a8 was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 15:04:10 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 15:04:10 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.part /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284636.0176992, b7fce05e-80ca-4a0f-950c-3c0933e5531a => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:04:11 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] VM Stopped (Lifecycle Event)
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fd09431e-19a5-41c6-b9cf-60fbc5ad7c7b None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-82eb33f1-1d35-4924-a5f8-bba8422e5662 req-0b9d513f-c3da-43e3-acb3-6d31794c75d5 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-82eb33f1-1d35-4924-a5f8-bba8422e5662 req-0b9d513f-c3da-43e3-acb3-6d31794c75d5 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-82eb33f1-1d35-4924-a5f8-bba8422e5662 req-0b9d513f-c3da-43e3-acb3-6d31794c75d5 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-82eb33f1-1d35-4924-a5f8-bba8422e5662 req-0b9d513f-c3da-43e3-acb3-6d31794c75d5 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-82eb33f1-1d35-4924-a5f8-bba8422e5662 req-0b9d513f-c3da-43e3-acb3-6d31794c75d5 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:11 user nova-compute[73079]: WARNING nova.compute.manager [req-82eb33f1-1d35-4924-a5f8-bba8422e5662 req-0b9d513f-c3da-43e3-acb3-6d31794c75d5 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state active and task_state rescuing.
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.part /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.converted" returned: 0 in 0.482s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "7b12f72ddd6f8947a9377dd1d174208a0a4dc307" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.121s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "7b12f72ddd6f8947a9377dd1d174208a0a4dc307" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "7b12f72ddd6f8947a9377dd1d174208a0a4dc307" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307 --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307,backing_fmt=raw /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307,backing_fmt=raw /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "7b12f72ddd6f8947a9377dd1d174208a0a4dc307" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.objects.instance [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'migration_context' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Start _get_guest_xml network_info=[{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "vif_mac": "fa:16:3e:39:e9:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '27b67725-e61a-486a-b422-ff4fc7acc8a8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '21da39cd-a1b6-4d4f-b579-19a06174d1ee', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9c2a7315-c524-4c66-9018-9f760bc3f2b6', 'attached_at': '', 'detached_at': '', 'volume_id': '38f9bf35-ed69-4781-9e55-b75e4fcfac69', 'serial': '38f9bf35-ed69-4781-9e55-b75e4fcfac69'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:04:11 user nova-compute[73079]: DEBUG nova.objects.instance [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'resources' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:04:12 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:04:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:04:12 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:04:12 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db0369-0042-4b26-a951-8f2ac99c7b17]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sPyJMfwG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 15:04:12 user nova-compute[73079]: node.name = iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69
Aug 17 15:04:12 user nova-compute[73079]: node.tpgt = -1
Aug 17 15:04:12 user nova-compute[73079]: node.startup = automatic
Aug 17 15:04:12 user nova-compute[73079]: node.leading_login = No
Aug 17 15:04:12 user nova-compute[73079]: iface.iscsi_ifacename = default
Aug 17 15:04:12 user nova-compute[73079]: iface.net_ifacename = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.ipaddress = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.prefix_len = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.hwaddress = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.transport_name = tcp
Aug 17 15:04:12 user nova-compute[73079]: iface.initiatorname = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.vlan_id = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.vlan_priority = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.vlan_state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.iface_num = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.mtu = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.port = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.bootproto = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.subnet_mask = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.gateway = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_alt_client_id = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_dns = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_learn_iqn = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_vendor_id_state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_vendor_id = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.dhcp_slp_da = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.fragmentation = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.gratuitous_arp = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.incoming_forwarding = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.tos_state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.tos = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.ttl = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.delayed_ack = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.tcp_nagle = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.tcp_wsf_state = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.tcp_wsf = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.tcp_timer_scale = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.tcp_timestamp = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.redirect = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.def_task_mgmt_timeout = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.header_digest = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.data_digest = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.immediate_data = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.initial_r2t = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.data_seq_inorder = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.data_pdu_inorder = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.erl = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.max_receive_data_len = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.first_burst_len = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.max_outstanding_r2t = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.max_burst_len = 0
Aug 17 15:04:12 user nova-compute[73079]: iface.chap_auth = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.bidi_chap = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.strict_login_compliance = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.discovery_auth = <empty>
Aug 17 15:04:12 user nova-compute[73079]: iface.discovery_logout = <empty>
Aug 17 15:04:12 user nova-compute[73079]: node.discovery_address = <empty>
Aug 17 15:04:12 user nova-compute[73079]: node.discovery_port = 0
Aug 17 15:04:12 user nova-compute[73079]: node.discovery_type = static
Aug 17 15:04:12 user nova-compute[73079]: node.session.initial_cmdsn = 0
Aug 17 15:04:12 user nova-compute[73079]: node.session.initial_login_retry_max = 8
Aug 17 15:04:12 user nova-compute[73079]: node.session.xmit_thread_priority = -20
Aug 17 15:04:12 user nova-compute[73079]: node.session.cmds_max = 128
Aug 17 15:04:12 user nova-compute[73079]: node.session.queue_depth = 32
Aug 17 15:04:12 user nova-compute[73079]: node.session.nr_sessions = 1
Aug 17 15:04:12 user nova-compute[73079]: node.session.auth.authmethod = CHAP
Aug 17 15:04:12 user nova-compute[73079]: node.session.auth.username = sPyJMfwG
Aug 17 15:04:12 user nova-compute[73079]: node.session.auth.password = ***
Aug 17 15:04:12 user nova-compute[73079]: node.session.auth.username_in = <empty>
Aug 17 15:04:12 user nova-compute[73079]: node.session.auth.password_in = <empty>
Aug 17 15:04:12 user nova-compute[73079]: node.session.auth.chap_algs = MD5
Aug 17 15:04:12 user nova-compute[73079]: node.session.timeo.replacement_timeout = 120
Aug 17 15:04:12 user nova-compute[73079]: node.session.err_timeo.abort_timeout = 15
Aug 17 15:04:12 user nova-compute[73079]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 15:04:12 user nova-compute[73079]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 15:04:12 user nova-compute[73079]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.FastAbort = Yes
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.InitialR2T = No
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.ImmediateData = Yes
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.MaxConnections = 1
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 15:04:12 user nova-compute[73079]: node.session.iscsi.ERL = 0
Aug 17 15:04:12 user nova-compute[73079]: node.session.scan = manual
Aug 17 15:04:12 user nova-compute[73079]: node.session.reopen_max = 0
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].address = 172.16.0.220
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].port = 3260
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].startup = manual
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].tcp.window_size = 524288
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].tcp.type_of_service = 0
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].timeo.logout_timeout = 15
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].timeo.login_timeout = 15
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].timeo.auth_timeout = 45
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].iscsi.DataDigest = None
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].iscsi.IFMarker = No
Aug 17 15:04:12 user nova-compute[73079]: node.conn[0].iscsi.OFMarker = No
Aug 17 15:04:12 user nova-compute[73079]: # END RECORD
Aug 17 15:04:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cbbe01-a45f-4fff-9056-c03b8e9d3545]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e43da8-84b0-422e-b712-f9b1a0f7147f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPyJMfwG {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPyJMfwG" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8abe5-add1-47bd-9913-8d367178fb72]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPyJMfwG'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b74e1-9c60-415a-9ee2-2ba5b112c111]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a280b87-5dd8-42f5-b830-806f99fdf763]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:12 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:12 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:12 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:12 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:12 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] HCTL ('36', '0', '0', 0) found on session 49 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a66ad11-5f43-4fd3-88a0-5085e3f4e476]: (4, ('0 0 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Searching for a device in session 49 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '23734316137643462', 'path': '/dev/sde'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734316137643462', 'path': '/dev/sde'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-103246472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-103246472',id=39,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-gsqd8r9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:02:46Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=9c2a7315-c524-4c66-9018-9f760bc3f2b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "vif_mac": "fa:16:3e:39:e9:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "vif_mac": "fa:16:3e:39:e9:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:04:12 user nova-compute[73079]:   <uuid>9c2a7315-c524-4c66-9018-9f760bc3f2b6</uuid>
Aug 17 15:04:12 user nova-compute[73079]:   <name>instance-00000027</name>
Aug 17 15:04:12 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:04:12 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:04:12 user nova-compute[73079]:   <metadata>
Aug 17 15:04:12 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:04:12 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:04:12 user nova-compute[73079]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-103246472</nova:name>
Aug 17 15:04:12 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:04:12</nova:creationTime>
Aug 17 15:04:12 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:04:12 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:04:12 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:04:12 user nova-compute[73079]:       <nova:owner>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:user uuid="5f67004af6654b5d80924a5c502a74f2">tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member</nova:user>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:project uuid="0edd4ad5f2eb4e728a71908d32d353d5">tempest-ServerBootFromVolumeStableRescueTest-2072772980</nova:project>
Aug 17 15:04:12 user nova-compute[73079]:       </nova:owner>
Aug 17 15:04:12 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:04:12 user nova-compute[73079]:       <nova:ports>
Aug 17 15:04:12 user nova-compute[73079]:         <nova:port uuid="162abcfd-c46e-45f8-b626-ff551ef3a40d">
Aug 17 15:04:12 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 15:04:12 user nova-compute[73079]:         </nova:port>
Aug 17 15:04:12 user nova-compute[73079]:       </nova:ports>
Aug 17 15:04:12 user nova-compute[73079]:     </nova:instance>
Aug 17 15:04:12 user nova-compute[73079]:   </metadata>
Aug 17 15:04:12 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:04:12 user nova-compute[73079]:     <system>
Aug 17 15:04:12 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:04:12 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:04:12 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:04:12 user nova-compute[73079]:       <entry name="serial">9c2a7315-c524-4c66-9018-9f760bc3f2b6</entry>
Aug 17 15:04:12 user nova-compute[73079]:       <entry name="uuid">9c2a7315-c524-4c66-9018-9f760bc3f2b6</entry>
Aug 17 15:04:12 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:04:12 user nova-compute[73079]:     </system>
Aug 17 15:04:12 user nova-compute[73079]:   </sysinfo>
Aug 17 15:04:12 user nova-compute[73079]:   <os>
Aug 17 15:04:12 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:04:12 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:04:12 user nova-compute[73079]:   </os>
Aug 17 15:04:12 user nova-compute[73079]:   <features>
Aug 17 15:04:12 user nova-compute[73079]:     <acpi/>
Aug 17 15:04:12 user nova-compute[73079]:     <apic/>
Aug 17 15:04:12 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:04:12 user nova-compute[73079]:   </features>
Aug 17 15:04:12 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:04:12 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:04:12 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:04:12 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:04:12 user nova-compute[73079]:   </clock>
Aug 17 15:04:12 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:04:12 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:04:12 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:04:12 user nova-compute[73079]:   </cpu>
Aug 17 15:04:12 user nova-compute[73079]:   <devices>
Aug 17 15:04:12 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:04:12 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:04:12 user nova-compute[73079]:       <source dev="/dev/sde"/>
Aug 17 15:04:12 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:04:12 user nova-compute[73079]:       <serial>38f9bf35-ed69-4781-9e55-b75e4fcfac69</serial>
Aug 17 15:04:12 user nova-compute[73079]:     </disk>
Aug 17 15:04:12 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:04:12 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:04:12 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue"/>
Aug 17 15:04:12 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 15:04:12 user nova-compute[73079]:       <boot order="1"/>
Aug 17 15:04:12 user nova-compute[73079]:     </disk>
Aug 17 15:04:12 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:04:12 user nova-compute[73079]:       <mac address="fa:16:3e:39:e9:fe"/>
Aug 17 15:04:12 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:04:12 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:04:12 user nova-compute[73079]:       <target dev="tap162abcfd-c4"/>
Aug 17 15:04:12 user nova-compute[73079]:     </interface>
Aug 17 15:04:12 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:04:12 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/console.log" append="off"/>
Aug 17 15:04:12 user nova-compute[73079]:     </serial>
Aug 17 15:04:12 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:04:12 user nova-compute[73079]:     <video>
Aug 17 15:04:12 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:04:12 user nova-compute[73079]:     </video>
Aug 17 15:04:12 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:04:12 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:04:12 user nova-compute[73079]:     </rng>
Aug 17 15:04:12 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:04:12 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:04:12 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:04:12 user nova-compute[73079]:     </memballoon>
Aug 17 15:04:12 user nova-compute[73079]:   </devices>
Aug 17 15:04:12 user nova-compute[73079]: </domain>
Aug 17 15:04:12 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:04:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance destroyed successfully.
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] No VIF found with MAC fa:16:3e:39:e9:fe, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:04:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-28f3f0df-fa35-4f61-918c-7c002ff97e4d req-b33b41c8-d520-442e-bd06-21806b335837 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-28f3f0df-fa35-4f61-918c-7c002ff97e4d req-b33b41c8-d520-442e-bd06-21806b335837 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-28f3f0df-fa35-4f61-918c-7c002ff97e4d req-b33b41c8-d520-442e-bd06-21806b335837 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-28f3f0df-fa35-4f61-918c-7c002ff97e4d req-b33b41c8-d520-442e-bd06-21806b335837 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-28f3f0df-fa35-4f61-918c-7c002ff97e4d req-b33b41c8-d520-442e-bd06-21806b335837 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:14 user nova-compute[73079]: WARNING nova.compute.manager [req-28f3f0df-fa35-4f61-918c-7c002ff97e4d req-b33b41c8-d520-442e-bd06-21806b335837 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state active and task_state rescuing.
Aug 17 15:04:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-8115db08-c81e-47bb-925e-78399a441fe4 req-38d29322-bace-4c3c-a525-de41dae30e6b service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8115db08-c81e-47bb-925e-78399a441fe4 req-38d29322-bace-4c3c-a525-de41dae30e6b service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8115db08-c81e-47bb-925e-78399a441fe4 req-38d29322-bace-4c3c-a525-de41dae30e6b service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8115db08-c81e-47bb-925e-78399a441fe4 req-38d29322-bace-4c3c-a525-de41dae30e6b service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-8115db08-c81e-47bb-925e-78399a441fe4 req-38d29322-bace-4c3c-a525-de41dae30e6b service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:16 user nova-compute[73079]: WARNING nova.compute.manager [req-8115db08-c81e-47bb-925e-78399a441fe4 req-38d29322-bace-4c3c-a525-de41dae30e6b service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state active and task_state rescuing.
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 9c2a7315-c524-4c66-9018-9f760bc3f2b6 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284656.0747488, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:04:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Resumed (Lifecycle Event)
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-13a5c220-ece7-4136-9321-ba9743ebd0ab tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:04:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284656.075007, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:04:16 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Started (Lifecycle Event)
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:04:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:04:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Creating image(s)
Aug 17 15:04:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.216s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk 1073741824" returned: 0 in 0.050s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Cannot resize image /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Ensure instance console log exists: /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Start _get_guest_xml network_info=[{"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': '10af9088-0d30-49e3-8ced-c6747a3b0a81', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7fce05e-80ca-4a0f-950c-3c0933e5531a', 'attached_at': '', 'detached_at': '', 'volume_id': '2318988b-ea08-456f-8ef9-2fe1fec1d27e', 'serial': '2318988b-ea08-456f-8ef9-2fe1fec1d27e'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:04:18 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 15:04:18 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:04:18 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:04:18 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:04:18 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292bc23-4104-44fd-95ea-5ff03ee267c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:04:18 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24820b7-8951-46ce-8804-2c8d4e748fbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e] added
Aug 17 15:04:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba62ea4-65f5-4780-8e2e-4743227a5d2f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a73e617-39b8-4732-a9ed-f06c3e564b95]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlfaFCTZ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wlfaFCTZ" returned: 0 in 0.028s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f57304-56e2-4ae9-830d-8222e43685fb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wlfaFCTZ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15db4de-6049-4572-884b-e5a0e673895c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9160c-c4ce-4ee5-befb-7201ce410fb5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cef947-ac6c-418b-8873-4bfec23e5176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]
Aug 17 15:04:19 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.
Aug 17 15:04:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a153b-0192-4490-827d-065256747ad9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e532a32e-0f82-476f-a461-a46771349045]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:04:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:04:19 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:04:19 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee814b9-2f6a-4d9f-8ddb-54a3c04d12bf]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:04:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23437633766666634', 'path': '/dev/sdd'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437633766666634', 'path': '/dev/sdd'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T15:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1172900661',display_name='tempest-ServerActionsTestOtherA-server-1424658385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1172900661',id=38,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX+AAtt4TkrBADqts0gHca3h7/0Z3/nMtYXzIkLvV367jDT+K3GZ9xwHFbrS82LunQOYn68jsDE2hEwj7rYxOxBwjRbLJP1WBFakRnUTWIyzJ4fXBInNNvIWj2q92INqA==',key_name='tempest-keypair-2084706945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:01:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-r80y8dew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=b7fce05e-80ca-4a0f-950c-3c0933e5531a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:04:20 user nova-compute[73079]:   <uuid>b7fce05e-80ca-4a0f-950c-3c0933e5531a</uuid>
Aug 17 15:04:20 user nova-compute[73079]:   <name>instance-00000026</name>
Aug 17 15:04:20 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:04:20 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:04:20 user nova-compute[73079]:   <metadata>
Aug 17 15:04:20 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:04:20 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:04:20 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherA-server-1424658385</nova:name>
Aug 17 15:04:20 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:04:18</nova:creationTime>
Aug 17 15:04:20 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:04:20 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:04:20 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:04:20 user nova-compute[73079]:       <nova:owner>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:user uuid="bcfb392dca9d4008b1ca9655cedaef6c">tempest-ServerActionsTestOtherA-1400100504-project-member</nova:user>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:project uuid="13613dce4b924a33b76cdfac1a23cb3c">tempest-ServerActionsTestOtherA-1400100504</nova:project>
Aug 17 15:04:20 user nova-compute[73079]:       </nova:owner>
Aug 17 15:04:20 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:04:20 user nova-compute[73079]:       <nova:ports>
Aug 17 15:04:20 user nova-compute[73079]:         <nova:port uuid="bd8b26ce-779d-4b58-98af-15a67ac1373d">
Aug 17 15:04:20 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:04:20 user nova-compute[73079]:         </nova:port>
Aug 17 15:04:20 user nova-compute[73079]:       </nova:ports>
Aug 17 15:04:20 user nova-compute[73079]:     </nova:instance>
Aug 17 15:04:20 user nova-compute[73079]:   </metadata>
Aug 17 15:04:20 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:04:20 user nova-compute[73079]:     <system>
Aug 17 15:04:20 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:04:20 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:04:20 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:04:20 user nova-compute[73079]:       <entry name="serial">b7fce05e-80ca-4a0f-950c-3c0933e5531a</entry>
Aug 17 15:04:20 user nova-compute[73079]:       <entry name="uuid">b7fce05e-80ca-4a0f-950c-3c0933e5531a</entry>
Aug 17 15:04:20 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:04:20 user nova-compute[73079]:     </system>
Aug 17 15:04:20 user nova-compute[73079]:   </sysinfo>
Aug 17 15:04:20 user nova-compute[73079]:   <os>
Aug 17 15:04:20 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:04:20 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:04:20 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:04:20 user nova-compute[73079]:   </os>
Aug 17 15:04:20 user nova-compute[73079]:   <features>
Aug 17 15:04:20 user nova-compute[73079]:     <acpi/>
Aug 17 15:04:20 user nova-compute[73079]:     <apic/>
Aug 17 15:04:20 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:04:20 user nova-compute[73079]:   </features>
Aug 17 15:04:20 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:04:20 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:04:20 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:04:20 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:04:20 user nova-compute[73079]:   </clock>
Aug 17 15:04:20 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:04:20 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:04:20 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:04:20 user nova-compute[73079]:   </cpu>
Aug 17 15:04:20 user nova-compute[73079]:   <devices>
Aug 17 15:04:20 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:04:20 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:04:20 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk"/>
Aug 17 15:04:20 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:04:20 user nova-compute[73079]:     </disk>
Aug 17 15:04:20 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:04:20 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:04:20 user nova-compute[73079]:       <source dev="/dev/sdd"/>
Aug 17 15:04:20 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 15:04:20 user nova-compute[73079]:       <serial>2318988b-ea08-456f-8ef9-2fe1fec1d27e</serial>
Aug 17 15:04:20 user nova-compute[73079]:     </disk>
Aug 17 15:04:20 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:04:20 user nova-compute[73079]:       <mac address="fa:16:3e:0b:c6:57"/>
Aug 17 15:04:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:04:20 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:04:20 user nova-compute[73079]:       <target dev="tapbd8b26ce-77"/>
Aug 17 15:04:20 user nova-compute[73079]:     </interface>
Aug 17 15:04:20 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:04:20 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/console.log" append="off"/>
Aug 17 15:04:20 user nova-compute[73079]:     </serial>
Aug 17 15:04:20 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:04:20 user nova-compute[73079]:     <video>
Aug 17 15:04:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:04:20 user nova-compute[73079]:     </video>
Aug 17 15:04:20 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:04:20 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:04:20 user nova-compute[73079]:     </rng>
Aug 17 15:04:20 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:04:20 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:04:20 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:04:20 user nova-compute[73079]:     </memballoon>
Aug 17 15:04:20 user nova-compute[73079]:   </devices>
Aug 17 15:04:20 user nova-compute[73079]: </domain>
Aug 17 15:04:20 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T15:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1172900661',display_name='tempest-ServerActionsTestOtherA-server-1424658385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1172900661',id=38,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX+AAtt4TkrBADqts0gHca3h7/0Z3/nMtYXzIkLvV367jDT+K3GZ9xwHFbrS82LunQOYn68jsDE2hEwj7rYxOxBwjRbLJP1WBFakRnUTWIyzJ4fXBInNNvIWj2q92INqA==',key_name='tempest-keypair-2084706945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:01:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-r80y8dew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=b7fce05e-80ca-4a0f-950c-3c0933e5531a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG os_vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd8b26ce-77, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd8b26ce-77, col_values=(('external_ids', {'iface-id': 'bd8b26ce-779d-4b58-98af-15a67ac1373d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c6:57', 'vm-uuid': 'b7fce05e-80ca-4a0f-950c-3c0933e5531a'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:20 user nova-compute[73079]: INFO os_vif [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77')
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:04:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No VIF found with MAC fa:16:3e:0b:c6:57, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:04:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-58cbba17-f5de-455f-b55e-ed55548b1003 req-8fbe12af-2996-4e19-b6ee-5f30c9ce5907 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-58cbba17-f5de-455f-b55e-ed55548b1003 req-8fbe12af-2996-4e19-b6ee-5f30c9ce5907 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-58cbba17-f5de-455f-b55e-ed55548b1003 req-8fbe12af-2996-4e19-b6ee-5f30c9ce5907 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-58cbba17-f5de-455f-b55e-ed55548b1003 req-8fbe12af-2996-4e19-b6ee-5f30c9ce5907 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-58cbba17-f5de-455f-b55e-ed55548b1003 req-8fbe12af-2996-4e19-b6ee-5f30c9ce5907 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:22 user nova-compute[73079]: WARNING nova.compute.manager [req-58cbba17-f5de-455f-b55e-ed55548b1003 req-8fbe12af-2996-4e19-b6ee-5f30c9ce5907 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuild_spawning.
Aug 17 15:04:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-61abc282-2ee0-4674-a503-15a22ed7a975 req-b04a302a-cd94-43dc-9d93-ae73650451b0 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-61abc282-2ee0-4674-a503-15a22ed7a975 req-b04a302a-cd94-43dc-9d93-ae73650451b0 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-61abc282-2ee0-4674-a503-15a22ed7a975 req-b04a302a-cd94-43dc-9d93-ae73650451b0 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-61abc282-2ee0-4674-a503-15a22ed7a975 req-b04a302a-cd94-43dc-9d93-ae73650451b0 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-61abc282-2ee0-4674-a503-15a22ed7a975 req-b04a302a-cd94-43dc-9d93-ae73650451b0 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:24 user nova-compute[73079]: WARNING nova.compute.manager [req-61abc282-2ee0-4674-a503-15a22ed7a975 req-b04a302a-cd94-43dc-9d93-ae73650451b0 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state active and task_state rebuild_spawning.
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284664.4213078, b7fce05e-80ca-4a0f-950c-3c0933e5531a => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:04:24 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] VM Resumed (Lifecycle Event)
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:24 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance spawned successfully.
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:04:24 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284664.4216578, b7fce05e-80ca-4a0f-950c-3c0933e5531a => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:04:24 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] VM Started (Lifecycle Event)
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:04:24 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73079) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:04:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fa08d03a-8368-4d60-8238-7fb374f721dd tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.158s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:04:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=25.13117218017578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b7fce05e-80ca-4a0f-950c-3c0933e5531a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 25703282-9d49-42a3-9eb5-1f22de3b388b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 0693416d-2ee8-4847-9249-ee10d085b3aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:04:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:04:26 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:04:26 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:04:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:04:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:04:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:56 user nova-compute[73079]: INFO nova.compute.manager [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Terminating instance
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-fcdaabc5-d694-4130-8be7-418ab00daaba req-9be2e8b5-c9b6-43df-87c2-68bf7a452f58 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-vif-unplugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fcdaabc5-d694-4130-8be7-418ab00daaba req-9be2e8b5-c9b6-43df-87c2-68bf7a452f58 service nova] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fcdaabc5-d694-4130-8be7-418ab00daaba req-9be2e8b5-c9b6-43df-87c2-68bf7a452f58 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fcdaabc5-d694-4130-8be7-418ab00daaba req-9be2e8b5-c9b6-43df-87c2-68bf7a452f58 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-fcdaabc5-d694-4130-8be7-418ab00daaba req-9be2e8b5-c9b6-43df-87c2-68bf7a452f58 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] No waiting events found dispatching network-vif-unplugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-fcdaabc5-d694-4130-8be7-418ab00daaba req-9be2e8b5-c9b6-43df-87c2-68bf7a452f58 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-vif-unplugged-be3de91e-62d1-457a-97c4-322ab3879385 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:04:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Instance destroyed successfully.
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lazy-loading 'resources' on Instance uuid 25703282-9d49-42a3-9eb5-1f22de3b388b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-245797924',display_name='tempest-VolumesActionsTest-instance-245797924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-245797924',id=40,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:03:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87b096133b2342ffa84c7c60354e4b2c',ramdisk_id='',reservation_id='r-ag7ki0f9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1667820847',owner_user_name='tempest-VolumesActionsTest-1667820847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:03:13Z,user_data=None,user_id='e045035e51f7437290769532c3190a5f',uuid=25703282-9d49-42a3-9eb5-1f22de3b388b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converting VIF {"id": "be3de91e-62d1-457a-97c4-322ab3879385", "address": "fa:16:3e:b7:29:56", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3de91e-62", "ovs_interfaceid": "be3de91e-62d1-457a-97c4-322ab3879385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG os_vif [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe3de91e-62, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:04:56 user nova-compute[73079]: INFO os_vif [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:29:56,bridge_name='br-int',has_traffic_filtering=True,id=be3de91e-62d1-457a-97c4-322ab3879385,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3de91e-62')
Aug 17 15:04:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Deleting instance files /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b_del
Aug 17 15:04:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Deletion of /opt/stack/data/nova/instances/25703282-9d49-42a3-9eb5-1f22de3b388b_del complete
Aug 17 15:04:56 user nova-compute[73079]: INFO nova.compute.manager [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 17 15:04:56 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:04:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:04:57 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Took 0.56 seconds to deallocate network for instance.
Aug 17 15:04:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-c8f18e45-14be-4105-9a36-a674ab9e5362 req-7f43cbdc-d430-4c7b-96ce-0b6b8ff25407 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-vif-deleted-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:57 user nova-compute[73079]: INFO nova.compute.manager [req-c8f18e45-14be-4105-9a36-a674ab9e5362 req-7f43cbdc-d430-4c7b-96ce-0b6b8ff25407 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Neutron deleted interface be3de91e-62d1-457a-97c4-322ab3879385; detaching it from the instance and deleting it from the info cache
Aug 17 15:04:57 user nova-compute[73079]: DEBUG nova.network.neutron [req-c8f18e45-14be-4105-9a36-a674ab9e5362 req-7f43cbdc-d430-4c7b-96ce-0b6b8ff25407 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-c8f18e45-14be-4105-9a36-a674ab9e5362 req-7f43cbdc-d430-4c7b-96ce-0b6b8ff25407 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Detach interface failed, port_id=be3de91e-62d1-457a-97c4-322ab3879385, reason: Instance 25703282-9d49-42a3-9eb5-1f22de3b388b could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:04:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:57 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Deleted allocations for instance 25703282-9d49-42a3-9eb5-1f22de3b388b
Aug 17 15:04:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5fcfb4e5-9cac-4b6a-bff5-6684dff26a75 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-4a393251-a6bb-4ca3-96f5-bcaa7aee3307 req-6ae04e4f-dd36-44c9-a00d-d8339c9989b5 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received event network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:04:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4a393251-a6bb-4ca3-96f5-bcaa7aee3307 req-6ae04e4f-dd36-44c9-a00d-d8339c9989b5 service nova] Acquiring lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:04:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4a393251-a6bb-4ca3-96f5-bcaa7aee3307 req-6ae04e4f-dd36-44c9-a00d-d8339c9989b5 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:04:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4a393251-a6bb-4ca3-96f5-bcaa7aee3307 req-6ae04e4f-dd36-44c9-a00d-d8339c9989b5 service nova] Lock "25703282-9d49-42a3-9eb5-1f22de3b388b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:04:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-4a393251-a6bb-4ca3-96f5-bcaa7aee3307 req-6ae04e4f-dd36-44c9-a00d-d8339c9989b5 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] No waiting events found dispatching network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:04:58 user nova-compute[73079]: WARNING nova.compute.manager [req-4a393251-a6bb-4ca3-96f5-bcaa7aee3307 req-6ae04e4f-dd36-44c9-a00d-d8339c9989b5 service nova] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Received unexpected event network-vif-plugged-be3de91e-62d1-457a-97c4-322ab3879385 for instance with vm_state deleted and task_state None.
Aug 17 15:05:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284696.7944026, 25703282-9d49-42a3-9eb5-1f22de3b388b => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:05:11 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] VM Stopped (Lifecycle Event)
Aug 17 15:05:11 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63a255ed-d51e-465c-850e-11ef13e96366 None None] [instance: 25703282-9d49-42a3-9eb5-1f22de3b388b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:05:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:16 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:05:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:05:19 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:19 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:23 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:05:23 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:05:23 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=25.126373291015625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b7fce05e-80ca-4a0f-950c-3c0933e5531a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 0693416d-2ee8-4847-9249-ee10d085b3aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:05:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-changed-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.compute.manager [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Refreshing instance network info cache due to event network-changed-27f04f18-ee2a-470f-91cb-9e8a7540def1. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] Acquiring lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] Acquired lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.network.neutron [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Refreshing network info cache for port 27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:05:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG nova.network.neutron [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updated VIF entry in instance network info cache for port 27f04f18-ee2a-470f-91cb-9e8a7540def1. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG nova.network.neutron [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updating instance_info_cache with network_info: [{"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-04a0aa79-2c1e-4d08-ac4c-6e4e12488950 req-af3fdb67-b90c-41fc-97cc-3d069afd8b24 service nova] Releasing lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [{"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-cf693095-4aa8-4b88-b9bd-fe9026c71d28" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:05:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:05:40 user nova-compute[73079]: INFO nova.compute.claims [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Claim successful on node user
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:05:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:05:40 user nova-compute[73079]: INFO nova.virt.block_device [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Booting with volume cb3f04b0-975a-481d-98b2-f76a150fa140 at /dev/vda
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.policy [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '722f38129c96487b8331cde0ab317832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9478b753e2040e799f28e18c5a82223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG os_brick.utils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2bce76-db17-4718-bde9-5e183a53fa4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb243f-8150-483a-b4c0-b150b83a019e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6298af9e-8edd-4ddd-a36e-1795a0aa49ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[242fcb98-5987-4f48-842f-13d3c068f8b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:05:40 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:05:40 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec5fd04-a675-4dc1-a4d9-11c859665b56]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG os_brick.utils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:05:40 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updating existing volume attachment record: b1f8caf0-b0dc-4078-8918-f93a403132df {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:05:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Successfully created port: c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:05:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Successfully updated port: c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquired lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-changed-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Refreshing instance network info cache due to event network-changed-c2730c13-6e61-46f0-b559-b29e16ac8f4c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] Acquiring lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:05:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updating instance_info_cache with network_info: [{"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Releasing lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Instance network_info: |[{"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] Acquired lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Refreshing network info cache for port c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updated VIF entry in instance network info cache for port c2730c13-6e61-46f0-b559-b29e16ac8f4c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updating instance_info_cache with network_info: [{"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9c77c922-af5c-4890-9938-c4bdc4f619dc req-b309ceb4-331f-4f22-8ad0-30492a559e29 service nova] Releasing lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "b9099ee0-b542-41d8-8925-1473f4f821df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:47 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:05:47 user nova-compute[73079]: INFO nova.compute.claims [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Claim successful on node user
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.network.neutron [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:05:48 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:05:48 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Creating image(s)
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "/opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "/opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG nova.policy [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e045035e51f7437290769532c3190a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87b096133b2342ffa84c7c60354e4b2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk 1073741824" returned: 0 in 0.054s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Successfully created port: d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Cannot resize image /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lazy-loading 'migration_context' on Instance uuid b9099ee0-b542-41d8-8925-1473f4f821df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Ensure instance console log exists: /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Successfully updated port: d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "refresh_cache-b9099ee0-b542-41d8-8925-1473f4f821df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquired lock "refresh_cache-b9099ee0-b542-41d8-8925-1473f4f821df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-changed-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Refreshing instance network info cache due to event network-changed-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] Acquiring lock "refresh_cache-b9099ee0-b542-41d8-8925-1473f4f821df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Updating instance_info_cache with network_info: [{"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Releasing lock "refresh_cache-b9099ee0-b542-41d8-8925-1473f4f821df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Instance network_info: |[{"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] Acquired lock "refresh_cache-b9099ee0-b542-41d8-8925-1473f4f821df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Refreshing network info cache for port d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Start _get_guest_xml network_info=[{"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:05:50 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:05:50 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-616517647',display_name='tempest-VolumesActionsTest-instance-616517647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-616517647',id=43,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87b096133b2342ffa84c7c60354e4b2c',ramdisk_id='',reservation_id='r-ro95nt20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1667820847',owner_user_name='tempest-VolumesActionsTest-1667820847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:05:48Z,user_data=None,user_id='e045035e51f7437290769532c3190a5f',uuid=b9099ee0-b542-41d8-8925-1473f4f821df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converting VIF {"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.objects.instance [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lazy-loading 'pci_devices' on Instance uuid b9099ee0-b542-41d8-8925-1473f4f821df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:05:50 user nova-compute[73079]:   <uuid>b9099ee0-b542-41d8-8925-1473f4f821df</uuid>
Aug 17 15:05:50 user nova-compute[73079]:   <name>instance-0000002b</name>
Aug 17 15:05:50 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:05:50 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:05:50 user nova-compute[73079]:   <metadata>
Aug 17 15:05:50 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:05:50 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:05:50 user nova-compute[73079]:       <nova:name>tempest-VolumesActionsTest-instance-616517647</nova:name>
Aug 17 15:05:50 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:05:50</nova:creationTime>
Aug 17 15:05:50 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:05:50 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:05:50 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:05:50 user nova-compute[73079]:       <nova:owner>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:user uuid="e045035e51f7437290769532c3190a5f">tempest-VolumesActionsTest-1667820847-project-member</nova:user>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:project uuid="87b096133b2342ffa84c7c60354e4b2c">tempest-VolumesActionsTest-1667820847</nova:project>
Aug 17 15:05:50 user nova-compute[73079]:       </nova:owner>
Aug 17 15:05:50 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:05:50 user nova-compute[73079]:       <nova:ports>
Aug 17 15:05:50 user nova-compute[73079]:         <nova:port uuid="d4fbdfee-cb2d-4fc5-a406-53e57a6fb315">
Aug 17 15:05:50 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 15:05:50 user nova-compute[73079]:         </nova:port>
Aug 17 15:05:50 user nova-compute[73079]:       </nova:ports>
Aug 17 15:05:50 user nova-compute[73079]:     </nova:instance>
Aug 17 15:05:50 user nova-compute[73079]:   </metadata>
Aug 17 15:05:50 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:05:50 user nova-compute[73079]:     <system>
Aug 17 15:05:50 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:05:50 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:05:50 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:05:50 user nova-compute[73079]:       <entry name="serial">b9099ee0-b542-41d8-8925-1473f4f821df</entry>
Aug 17 15:05:50 user nova-compute[73079]:       <entry name="uuid">b9099ee0-b542-41d8-8925-1473f4f821df</entry>
Aug 17 15:05:50 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:05:50 user nova-compute[73079]:     </system>
Aug 17 15:05:50 user nova-compute[73079]:   </sysinfo>
Aug 17 15:05:50 user nova-compute[73079]:   <os>
Aug 17 15:05:50 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:05:50 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:05:50 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:05:50 user nova-compute[73079]:   </os>
Aug 17 15:05:50 user nova-compute[73079]:   <features>
Aug 17 15:05:50 user nova-compute[73079]:     <acpi/>
Aug 17 15:05:50 user nova-compute[73079]:     <apic/>
Aug 17 15:05:50 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:05:50 user nova-compute[73079]:   </features>
Aug 17 15:05:50 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:05:50 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:05:50 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:05:50 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:05:50 user nova-compute[73079]:   </clock>
Aug 17 15:05:50 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:05:50 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:05:50 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:05:50 user nova-compute[73079]:   </cpu>
Aug 17 15:05:50 user nova-compute[73079]:   <devices>
Aug 17 15:05:50 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:05:50 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:05:50 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk"/>
Aug 17 15:05:50 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:05:50 user nova-compute[73079]:     </disk>
Aug 17 15:05:50 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:05:50 user nova-compute[73079]:       <mac address="fa:16:3e:57:9a:a4"/>
Aug 17 15:05:50 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:05:50 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:05:50 user nova-compute[73079]:       <target dev="tapd4fbdfee-cb"/>
Aug 17 15:05:50 user nova-compute[73079]:     </interface>
Aug 17 15:05:50 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:05:50 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/console.log" append="off"/>
Aug 17 15:05:50 user nova-compute[73079]:     </serial>
Aug 17 15:05:50 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:05:50 user nova-compute[73079]:     <video>
Aug 17 15:05:50 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:05:50 user nova-compute[73079]:     </video>
Aug 17 15:05:50 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:05:50 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:05:50 user nova-compute[73079]:     </rng>
Aug 17 15:05:50 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:05:50 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:05:50 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:05:50 user nova-compute[73079]:     </memballoon>
Aug 17 15:05:50 user nova-compute[73079]:   </devices>
Aug 17 15:05:50 user nova-compute[73079]: </domain>
Aug 17 15:05:50 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-616517647',display_name='tempest-VolumesActionsTest-instance-616517647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-616517647',id=43,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87b096133b2342ffa84c7c60354e4b2c',ramdisk_id='',reservation_id='r-ro95nt20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1667820847',owner_user_name='tempest-VolumesActionsTest-1667820847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:05:48Z,user_data=None,user_id='e045035e51f7437290769532c3190a5f',uuid=b9099ee0-b542-41d8-8925-1473f4f821df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converting VIF {"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG os_vif [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4fbdfee-cb, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4fbdfee-cb, col_values=(('external_ids', {'iface-id': 'd4fbdfee-cb2d-4fc5-a406-53e57a6fb315', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:9a:a4', 'vm-uuid': 'b9099ee0-b542-41d8-8925-1473f4f821df'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:50 user nova-compute[73079]: INFO os_vif [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb')
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] No VIF found with MAC fa:16:3e:57:9a:a4, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Updated VIF entry in instance network info cache for port d4fbdfee-cb2d-4fc5-a406-53e57a6fb315. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG nova.network.neutron [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Updating instance_info_cache with network_info: [{"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72d0cfe8-c0ee-46e5-aaec-c700eaed5d5c req-c18a6af7-e6d0-4bea-a7d4-a99903b6c1a7 service nova] Releasing lock "refresh_cache-b9099ee0-b542-41d8-8925-1473f4f821df" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-6982deb8-7681-491c-92f7-a60fb5a1162b req-62aefa6a-1351-4ea8-af7e-db056ad2fafd service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6982deb8-7681-491c-92f7-a60fb5a1162b req-62aefa6a-1351-4ea8-af7e-db056ad2fafd service nova] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6982deb8-7681-491c-92f7-a60fb5a1162b req-62aefa6a-1351-4ea8-af7e-db056ad2fafd service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6982deb8-7681-491c-92f7-a60fb5a1162b req-62aefa6a-1351-4ea8-af7e-db056ad2fafd service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-6982deb8-7681-491c-92f7-a60fb5a1162b req-62aefa6a-1351-4ea8-af7e-db056ad2fafd service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] No waiting events found dispatching network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:05:52 user nova-compute[73079]: WARNING nova.compute.manager [req-6982deb8-7681-491c-92f7-a60fb5a1162b req-62aefa6a-1351-4ea8-af7e-db056ad2fafd service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received unexpected event network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 for instance with vm_state building and task_state spawning.
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:05:52 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Creating image(s)
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Ensure instance console log exists: /opt/stack/data/nova/instances/c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Start _get_guest_xml network_info=[{"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'b1f8caf0-b0dc-4078-8918-f93a403132df', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiFWzhSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb3f04b0-975a-481d-98b2-f76a150fa140', 'serial': 'cb3f04b0-975a-481d-98b2-f76a150fa140'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:05:52 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:05:52 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiFWzhSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:05:52 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:05:52 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:05:52 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:05:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[541cb712-781c-49ad-88d2-918d644e28c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:05:52 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d721a-6d78-4bf2-be48-5414956a62b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140] added
Aug 17 15:05:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f33cab4-c89b-4abb-921f-00714b983953]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34f4d5-ee8a-4ffa-ab40-4a173dedc735]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MiFWzhSE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MiFWzhSE" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e77e5-bb87-4afa-89d8-642c9caee5d1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MiFWzhSE'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[267378eb-03fa-49e1-9693-18be0db8e7bf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34bcde3-b184-46c1-985f-380044d39003]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e09f60-038e-47a4-a07a-5e7a231a8a62 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e09f60-038e-47a4-a07a-5e7a231a8a62 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e09f60-038e-47a4-a07a-5e7a231a8a62 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e229cb-5595-4208-9649-80ab8f3a0743]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260]
Aug 17 15:05:52 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260] successful.
Aug 17 15:05:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11aefd-fdb4-41c3-94d9-9eda8d65c572]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4e6ff-7e7e-40ac-942d-816b5164b24f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e09f60-038e-47a4-a07a-5e7a231a8a62 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e09f60-038e-47a4-a07a-5e7a231a8a62 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89e09f60-038e-47a4-a07a-5e7a231a8a62 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)
Aug 17 15:05:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] HCTL ('38', '-', '-', 0) found on session 54 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.072s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88c815b-ffb3-4518-817f-b9b5dbd627a1]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Searching for a device in session 54 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:05:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiFWzhSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26532393331613064', 'path': '/dev/sdg'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532393331613064', 'path': '/dev/sdg'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1575943611',display_name='tempest-TestVolumeBootPattern-server-1575943611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1575943611',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-k31sbk9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:05:41Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'pci_devices' on Instance uuid c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:05:53 user nova-compute[73079]:   <uuid>c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9</uuid>
Aug 17 15:05:53 user nova-compute[73079]:   <name>instance-0000002a</name>
Aug 17 15:05:53 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:05:53 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:05:53 user nova-compute[73079]:   <metadata>
Aug 17 15:05:53 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:05:53 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:05:53 user nova-compute[73079]:       <nova:name>tempest-TestVolumeBootPattern-server-1575943611</nova:name>
Aug 17 15:05:53 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:05:52</nova:creationTime>
Aug 17 15:05:53 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:05:53 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:05:53 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:05:53 user nova-compute[73079]:       <nova:owner>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:user uuid="722f38129c96487b8331cde0ab317832">tempest-TestVolumeBootPattern-1112851866-project-member</nova:user>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:project uuid="c9478b753e2040e799f28e18c5a82223">tempest-TestVolumeBootPattern-1112851866</nova:project>
Aug 17 15:05:53 user nova-compute[73079]:       </nova:owner>
Aug 17 15:05:53 user nova-compute[73079]:       <nova:ports>
Aug 17 15:05:53 user nova-compute[73079]:         <nova:port uuid="c2730c13-6e61-46f0-b559-b29e16ac8f4c">
Aug 17 15:05:53 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 15:05:53 user nova-compute[73079]:         </nova:port>
Aug 17 15:05:53 user nova-compute[73079]:       </nova:ports>
Aug 17 15:05:53 user nova-compute[73079]:     </nova:instance>
Aug 17 15:05:53 user nova-compute[73079]:   </metadata>
Aug 17 15:05:53 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:05:53 user nova-compute[73079]:     <system>
Aug 17 15:05:53 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:05:53 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:05:53 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:05:53 user nova-compute[73079]:       <entry name="serial">c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9</entry>
Aug 17 15:05:53 user nova-compute[73079]:       <entry name="uuid">c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9</entry>
Aug 17 15:05:53 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:05:53 user nova-compute[73079]:     </system>
Aug 17 15:05:53 user nova-compute[73079]:   </sysinfo>
Aug 17 15:05:53 user nova-compute[73079]:   <os>
Aug 17 15:05:53 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:05:53 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:05:53 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:05:53 user nova-compute[73079]:   </os>
Aug 17 15:05:53 user nova-compute[73079]:   <features>
Aug 17 15:05:53 user nova-compute[73079]:     <acpi/>
Aug 17 15:05:53 user nova-compute[73079]:     <apic/>
Aug 17 15:05:53 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:05:53 user nova-compute[73079]:   </features>
Aug 17 15:05:53 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:05:53 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:05:53 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:05:53 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:05:53 user nova-compute[73079]:   </clock>
Aug 17 15:05:53 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:05:53 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:05:53 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:05:53 user nova-compute[73079]:   </cpu>
Aug 17 15:05:53 user nova-compute[73079]:   <devices>
Aug 17 15:05:53 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:05:53 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:05:53 user nova-compute[73079]:       <source dev="/dev/sdg"/>
Aug 17 15:05:53 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:05:53 user nova-compute[73079]:       <serial>cb3f04b0-975a-481d-98b2-f76a150fa140</serial>
Aug 17 15:05:53 user nova-compute[73079]:     </disk>
Aug 17 15:05:53 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:05:53 user nova-compute[73079]:       <mac address="fa:16:3e:f6:c6:2c"/>
Aug 17 15:05:53 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:05:53 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:05:53 user nova-compute[73079]:       <target dev="tapc2730c13-6e"/>
Aug 17 15:05:53 user nova-compute[73079]:     </interface>
Aug 17 15:05:53 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:05:53 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9/console.log" append="off"/>
Aug 17 15:05:53 user nova-compute[73079]:     </serial>
Aug 17 15:05:53 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:05:53 user nova-compute[73079]:     <video>
Aug 17 15:05:53 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:05:53 user nova-compute[73079]:     </video>
Aug 17 15:05:53 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:05:53 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:05:53 user nova-compute[73079]:     </rng>
Aug 17 15:05:53 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:05:53 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:05:53 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:05:53 user nova-compute[73079]:     </memballoon>
Aug 17 15:05:53 user nova-compute[73079]:   </devices>
Aug 17 15:05:53 user nova-compute[73079]: </domain>
Aug 17 15:05:53 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1575943611',display_name='tempest-TestVolumeBootPattern-server-1575943611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1575943611',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-k31sbk9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:05:41Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG os_vif [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2730c13-6e, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2730c13-6e, col_values=(('external_ids', {'iface-id': 'c2730c13-6e61-46f0-b559-b29e16ac8f4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c6:2c', 'vm-uuid': 'c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:53 user nova-compute[73079]: INFO os_vif [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e')
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:05:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] No VIF found with MAC fa:16:3e:f6:c6:2c, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284754.191652, b9099ee0-b542-41d8-8925-1473f4f821df => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] VM Resumed (Lifecycle Event)
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Instance spawned successfully.
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-1605ee25-e2d7-40e9-a0ae-eb44fdbdca28 req-6c800e5a-2612-49de-b129-be6e2751dc73 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1605ee25-e2d7-40e9-a0ae-eb44fdbdca28 req-6c800e5a-2612-49de-b129-be6e2751dc73 service nova] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1605ee25-e2d7-40e9-a0ae-eb44fdbdca28 req-6c800e5a-2612-49de-b129-be6e2751dc73 service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1605ee25-e2d7-40e9-a0ae-eb44fdbdca28 req-6c800e5a-2612-49de-b129-be6e2751dc73 service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-1605ee25-e2d7-40e9-a0ae-eb44fdbdca28 req-6c800e5a-2612-49de-b129-be6e2751dc73 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] No waiting events found dispatching network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:05:54 user nova-compute[73079]: WARNING nova.compute.manager [req-1605ee25-e2d7-40e9-a0ae-eb44fdbdca28 req-6c800e5a-2612-49de-b129-be6e2751dc73 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received unexpected event network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 for instance with vm_state building and task_state spawning.
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284754.1964452, b9099ee0-b542-41d8-8925-1473f4f821df => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] VM Started (Lifecycle Event)
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 17 15:05:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:54 user nova-compute[73079]: INFO nova.compute.manager [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Took 6.54 seconds to build instance.
Aug 17 15:05:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-94c4665f-d225-4113-8c4e-fd0b123dea94 tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "b9099ee0-b542-41d8-8925-1473f4f821df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.637s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-247bf2b7-3e22-43bf-b338-d890b3a0621f req-4bfb5464-a589-476e-9b6d-964e73257797 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-247bf2b7-3e22-43bf-b338-d890b3a0621f req-4bfb5464-a589-476e-9b6d-964e73257797 service nova] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-247bf2b7-3e22-43bf-b338-d890b3a0621f req-4bfb5464-a589-476e-9b6d-964e73257797 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-247bf2b7-3e22-43bf-b338-d890b3a0621f req-4bfb5464-a589-476e-9b6d-964e73257797 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG nova.compute.manager [req-247bf2b7-3e22-43bf-b338-d890b3a0621f req-4bfb5464-a589-476e-9b6d-964e73257797 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] No waiting events found dispatching network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:05:55 user nova-compute[73079]: WARNING nova.compute.manager [req-247bf2b7-3e22-43bf-b338-d890b3a0621f req-4bfb5464-a589-476e-9b6d-964e73257797 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received unexpected event network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c for instance with vm_state building and task_state spawning.
Aug 17 15:05:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284757.4995103, c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] VM Resumed (Lifecycle Event)
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Instance spawned successfully.
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284757.5024402, c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] VM Started (Lifecycle Event)
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Took 5.26 seconds to spawn the instance on the hypervisor.
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-2453a21c-69e5-47e8-9a79-d5c42d02963d req-cdcce167-9fcb-4b32-a2d2-2d4c2ac77b74 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2453a21c-69e5-47e8-9a79-d5c42d02963d req-cdcce167-9fcb-4b32-a2d2-2d4c2ac77b74 service nova] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2453a21c-69e5-47e8-9a79-d5c42d02963d req-cdcce167-9fcb-4b32-a2d2-2d4c2ac77b74 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2453a21c-69e5-47e8-9a79-d5c42d02963d req-cdcce167-9fcb-4b32-a2d2-2d4c2ac77b74 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:57 user nova-compute[73079]: DEBUG nova.compute.manager [req-2453a21c-69e5-47e8-9a79-d5c42d02963d req-cdcce167-9fcb-4b32-a2d2-2d4c2ac77b74 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] No waiting events found dispatching network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:05:57 user nova-compute[73079]: WARNING nova.compute.manager [req-2453a21c-69e5-47e8-9a79-d5c42d02963d req-cdcce167-9fcb-4b32-a2d2-2d4c2ac77b74 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received unexpected event network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c for instance with vm_state building and task_state spawning.
Aug 17 15:05:57 user nova-compute[73079]: INFO nova.compute.manager [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Took 17.45 seconds to build instance.
Aug 17 15:05:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-138286cf-548c-47f4-8902-1a40c35cbf61 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.552s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:05:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:58 user nova-compute[73079]: INFO nova.compute.manager [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Unrescuing
Aug 17 15:05:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:05:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquired lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:05:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:05:59 user nova-compute[73079]: DEBUG nova.network.neutron [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating instance_info_cache with network_info: [{"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:05:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Releasing lock "refresh_cache-9c2a7315-c524-4c66-9018-9f760bc3f2b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:05:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'flavor' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:05:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:05:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-74826ceb-1913-4836-9680-719472c0f973 req-a0444337-efb4-49b6-95a6-a7800d82d039 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-74826ceb-1913-4836-9680-719472c0f973 req-a0444337-efb4-49b6-95a6-a7800d82d039 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-74826ceb-1913-4836-9680-719472c0f973 req-a0444337-efb4-49b6-95a6-a7800d82d039 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-74826ceb-1913-4836-9680-719472c0f973 req-a0444337-efb4-49b6-95a6-a7800d82d039 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-74826ceb-1913-4836-9680-719472c0f973 req-a0444337-efb4-49b6-95a6-a7800d82d039 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:06:00 user nova-compute[73079]: WARNING nova.compute.manager [req-74826ceb-1913-4836-9680-719472c0f973 req-a0444337-efb4-49b6-95a6-a7800d82d039 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:06:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:00 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance destroyed successfully.
Aug 17 15:06:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:06:02 user nova-compute[73079]: WARNING nova.compute.manager [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:06:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:06:02 user nova-compute[73079]: WARNING nova.compute.manager [req-668d7b97-374a-4a26-891d-ba6a8a14f125 req-5be8b034-40b6-4bd1-81bc-3dbd8b239938 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:06:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 9c2a7315-c524-4c66-9018-9f760bc3f2b6 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284764.2464354, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:06:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Resumed (Lifecycle Event)
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-2a512220-3bae-46d1-8aa9-a027dc0262dc tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd3a8ac1-73d9-40f1-bc57-0c3d22b6244c req-ed010419-9c09-4eae-ba30-1f771652b1f4 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd3a8ac1-73d9-40f1-bc57-0c3d22b6244c req-ed010419-9c09-4eae-ba30-1f771652b1f4 service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd3a8ac1-73d9-40f1-bc57-0c3d22b6244c req-ed010419-9c09-4eae-ba30-1f771652b1f4 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dd3a8ac1-73d9-40f1-bc57-0c3d22b6244c req-ed010419-9c09-4eae-ba30-1f771652b1f4 service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [req-dd3a8ac1-73d9-40f1-bc57-0c3d22b6244c req-ed010419-9c09-4eae-ba30-1f771652b1f4 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:06:04 user nova-compute[73079]: WARNING nova.compute.manager [req-dd3a8ac1-73d9-40f1-bc57-0c3d22b6244c req-ed010419-9c09-4eae-ba30-1f771652b1f4 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:06:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284764.253848, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:06:04 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Started (Lifecycle Event)
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:06:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:06:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:06:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:06:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:06:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7801MB free_disk=25.079681396484375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b7fce05e-80ca-4a0f-950c-3c0933e5531a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 0693416d-2ee8-4847-9249-ee10d085b3aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b9099ee0-b542-41d8-8925-1473f4f821df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:06:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [{"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-168eb979-11c1-4643-a2e2-b160cbc5f150" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:06:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:06:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:30 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:06:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:06:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:06:46 user nova-compute[73079]: INFO nova.compute.manager [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Detaching volume 2318988b-ea08-456f-8ef9-2fe1fec1d27e
Aug 17 15:06:46 user nova-compute[73079]: INFO nova.virt.block_device [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Attempting to driver detach volume 2318988b-ea08-456f-8ef9-2fe1fec1d27e from mountpoint /dev/vdb
Aug 17 15:06:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Attempting to detach device vdb from instance b7fce05e-80ca-4a0f-950c-3c0933e5531a from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:06:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:06:46 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:06:46 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:06:46 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:06:46 user nova-compute[73079]:   <serial>2318988b-ea08-456f-8ef9-2fe1fec1d27e</serial>
Aug 17 15:06:46 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 15:06:46 user nova-compute[73079]: </disk>
Aug 17 15:06:46 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:06:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully detached device vdb from instance b7fce05e-80ca-4a0f-950c-3c0933e5531a from the persistent domain config.
Aug 17 15:06:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7fce05e-80ca-4a0f-950c-3c0933e5531a from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:06:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:06:46 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:06:46 user nova-compute[73079]:   <source dev="/dev/sdd"/>
Aug 17 15:06:46 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:06:46 user nova-compute[73079]:   <serial>2318988b-ea08-456f-8ef9-2fe1fec1d27e</serial>
Aug 17 15:06:46 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 15:06:46 user nova-compute[73079]: </disk>
Aug 17 15:06:46 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692284807.391262, b7fce05e-80ca-4a0f-950c-3c0933e5531a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:06:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully detached device vdb from instance b7fce05e-80ca-4a0f-950c-3c0933e5531a from the live domain config.
Aug 17 15:06:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wlfaFCTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:06:47 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa0837f-89fb-4459-969f-011ddff1275f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a311b9-fbb7-4cef-bf40-ad439b322803]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)
Aug 17 15:06:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e (non-flash)
Aug 17 15:06:47 user nova-compute[73079]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)
Aug 17 15:06:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f7845fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e'): ({'sdd'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Removing single pathed devices sdd {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4dbb4f-f1e9-4d15-af72-932345663a0d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f98ca47-beb8-40f3-91b4-c8eb1eb5b5ad]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flushing IO for device /dev/sdd {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[45513096-e341-4bf3-b3f0-ce0cf265f4d4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41fbbd-de0b-4ca7-8b23-1f5bdf3f0cd3]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] SCSI volumes sdd have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fdfaba-773c-4c0a-9aa2-3c19213c14b8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd6e009-a4f2-4fc2-b362-2e2b96edaff3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260]
Aug 17 15:06:47 user nova-compute[73079]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e, portal: 172.16.0.220,3260] successful.
Aug 17 15:06:47 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2318988b-ea08-456f-8ef9-2fe1fec1d27e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5a3f2f-6b6d-48eb-a158-423e682256c9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== disconnect_volume: return (369ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:06:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:06:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:51 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'flavor' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:06:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5048d7a8-7214-4891-8044-c8cf0aec1ae5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.177s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:06:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:06:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:06:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:06:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:06:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:06:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:07:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 527647ad-d7ef-456f-a03b-3c2cd7572ce4 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 0693416d-2ee8-4847-9249-ee10d085b3aa {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid b9099ee0-b542-41d8-8925-1473f4f821df {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "b9099ee0-b542-41d8-8925-1473f4f821df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "b9099ee0-b542-41d8-8925-1473f4f821df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:24 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:07:24 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:07:24 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=7875MB free_disk=25.069595336914062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b7fce05e-80ca-4a0f-950c-3c0933e5531a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 0693416d-2ee8-4847-9249-ee10d085b3aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance b9099ee0-b542-41d8-8925-1473f4f821df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:07:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:07:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:07:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-changed-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Refreshing instance network info cache due to event network-changed-c2730c13-6e61-46f0-b559-b29e16ac8f4c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:07:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] Acquiring lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:07:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] Acquired lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:07:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Refreshing network info cache for port c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updated VIF entry in instance network info cache for port c2730c13-6e61-46f0-b559-b29e16ac8f4c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updating instance_info_cache with network_info: [{"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-081ee2b5-63ba-4c9b-acba-0b00fd7948ed req-b884c517-a6c6-49b4-a2cf-3aaff0cb4d46 service nova] Releasing lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:33 user nova-compute[73079]: INFO nova.compute.manager [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Terminating instance
Aug 17 15:07:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Instance destroyed successfully.
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'resources' on Instance uuid c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1575943611',display_name='tempest-TestVolumeBootPattern-server-1575943611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1575943611',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-k31sbk9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:05:58Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_vif [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2730c13-6e, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:34 user nova-compute[73079]: INFO os_vif [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=c2730c13-6e61-46f0-b559-b29e16ac8f4c,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2730c13-6e')
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MiFWzhSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:07:34 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[94434513-8985-49df-92ee-4bf16b761dfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6937075-d0b6-42b2-9bd4-76297c61d439]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:07:34 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:07:34 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:07:34 user nova-compute[73079]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)
Aug 17 15:07:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:07:34 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:07:34 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:07:34 user nova-compute[73079]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 (non-flash)
Aug 17 15:07:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f78ddea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140'): ({'sdg'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Removing single pathed devices sdg {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e0cbef-f580-482f-9699-47ca1b38cd8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ce607-e4d1-451b-8cee-8cfe836b35fa]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flushing IO for device /dev/sdg {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b1e35-a13a-4a98-a443-b18f0fe87717]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef62ec-cb6c-4cd1-83ba-1f54c253f699]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] SCSI volumes sdg have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf94fcec',) {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e477d4e0-c826-4925-9aff-2fe2bf28f34b]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae315ef6-802b-4a72-8ee3-ad883350fbf5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc90d477-875e-41b6-89bd-fb69c026ee63]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260]
Aug 17 15:07:34 user nova-compute[73079]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140, portal: 172.16.0.220,3260] successful.
Aug 17 15:07:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-changed-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Refreshing instance network info cache due to event network-changed-c2730c13-6e61-46f0-b559-b29e16ac8f4c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Acquiring lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Acquired lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Refreshing network info cache for port c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3f04b0-975a-481d-98b2-f76a150fa140 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed91f57c-9a7a-407b-92a2-4ff1057444bf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== disconnect_volume: return (339ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:07:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Deleting instance files /opt/stack/data/nova/instances/c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9_del
Aug 17 15:07:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Deletion of /opt/stack/data/nova/instances/c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9_del complete
Aug 17 15:07:34 user nova-compute[73079]: INFO nova.compute.manager [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 17 15:07:34 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:07:34 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.network.neutron [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updated VIF entry in instance network info cache for port c2730c13-6e61-46f0-b559-b29e16ac8f4c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.network.neutron [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updating instance_info_cache with network_info: [{"id": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "address": "fa:16:3e:f6:c6:2c", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2730c13-6e", "ovs_interfaceid": "c2730c13-6e61-46f0-b559-b29e16ac8f4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Releasing lock "refresh_cache-c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-vif-unplugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] No waiting events found dispatching network-vif-unplugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-vif-unplugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Acquiring lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] No waiting events found dispatching network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:35 user nova-compute[73079]: WARNING nova.compute.manager [req-5d0e417e-2a47-48c2-9b15-22af41c61a65 req-11495b91-b735-4d09-aadd-64aec65c81a6 service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received unexpected event network-vif-plugged-c2730c13-6e61-46f0-b559-b29e16ac8f4c for instance with vm_state active and task_state deleting.
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:35 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Took 0.71 seconds to deallocate network for instance.
Aug 17 15:07:35 user nova-compute[73079]: DEBUG nova.compute.manager [req-5b9e6b8b-0932-4250-a205-a1c0d4aef04d req-c94a56bd-6075-4b38-a22e-4a704fe7a79c service nova] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Received event network-vif-deleted-c2730c13-6e61-46f0-b559-b29e16ac8f4c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:36 user nova-compute[73079]: INFO nova.compute.manager [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:36 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Deleted allocations for instance c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-adbb532f-c969-410e-85a8-49e5ccb1aa33 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:36 user nova-compute[73079]: INFO nova.compute.manager [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Terminating instance
Aug 17 15:07:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-42c1ac01-553f-46ec-aad7-51a79b1a77b9 req-8203384e-8ad7-4098-ba44-3a79589b2e08 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-42c1ac01-553f-46ec-aad7-51a79b1a77b9 req-8203384e-8ad7-4098-ba44-3a79589b2e08 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-42c1ac01-553f-46ec-aad7-51a79b1a77b9 req-8203384e-8ad7-4098-ba44-3a79589b2e08 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-42c1ac01-553f-46ec-aad7-51a79b1a77b9 req-8203384e-8ad7-4098-ba44-3a79589b2e08 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-42c1ac01-553f-46ec-aad7-51a79b1a77b9 req-8203384e-8ad7-4098-ba44-3a79589b2e08 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-42c1ac01-553f-46ec-aad7-51a79b1a77b9 req-8203384e-8ad7-4098-ba44-3a79589b2e08 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-unplugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Instance destroyed successfully.
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.objects.instance [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'resources' on Instance uuid b7fce05e-80ca-4a0f-950c-3c0933e5531a {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T15:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1172900661',display_name='tempest-ServerActionsTestOtherA-server-1424658385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1172900661',id=38,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX+AAtt4TkrBADqts0gHca3h7/0Z3/nMtYXzIkLvV367jDT+K3GZ9xwHFbrS82LunQOYn68jsDE2hEwj7rYxOxBwjRbLJP1WBFakRnUTWIyzJ4fXBInNNvIWj2q92INqA==',key_name='tempest-keypair-2084706945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-r80y8dew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=b7fce05e-80ca-4a0f-950c-3c0933e5531a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "address": "fa:16:3e:0b:c6:57", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8b26ce-77", "ovs_interfaceid": "bd8b26ce-779d-4b58-98af-15a67ac1373d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG os_vif [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd8b26ce-77, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:37 user nova-compute[73079]: INFO os_vif [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:c6:57,bridge_name='br-int',has_traffic_filtering=True,id=bd8b26ce-779d-4b58-98af-15a67ac1373d,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8b26ce-77')
Aug 17 15:07:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Deleting instance files /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a_del
Aug 17 15:07:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Deletion of /opt/stack/data/nova/instances/b7fce05e-80ca-4a0f-950c-3c0933e5531a_del complete
Aug 17 15:07:37 user nova-compute[73079]: INFO nova.compute.manager [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 15:07:37 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:07:37 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:38 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Took 0.77 seconds to deallocate network for instance.
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "b9099ee0-b542-41d8-8925-1473f4f821df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG nova.compute.manager [req-3a280779-2b9e-455c-92f6-b55766d80165 req-a7671892-3873-4afb-b864-f5a6d87c131a service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-deleted-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:38 user nova-compute[73079]: INFO nova.compute.manager [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Terminating instance
Aug 17 15:07:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:38 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Deleted allocations for instance b7fce05e-80ca-4a0f-950c-3c0933e5531a
Aug 17 15:07:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-6af0100c-6872-4d33-9397-48c550e78bcf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.159s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:39 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Instance destroyed successfully.
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.objects.instance [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lazy-loading 'resources' on Instance uuid b9099ee0-b542-41d8-8925-1473f4f821df {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-616517647',display_name='tempest-VolumesActionsTest-instance-616517647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-616517647',id=43,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:05:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87b096133b2342ffa84c7c60354e4b2c',ramdisk_id='',reservation_id='r-ro95nt20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1667820847',owner_user_name='tempest-VolumesActionsTest-1667820847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:05:54Z,user_data=None,user_id='e045035e51f7437290769532c3190a5f',uuid=b9099ee0-b542-41d8-8925-1473f4f821df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converting VIF {"id": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "address": "fa:16:3e:57:9a:a4", "network": {"id": "7262461e-ad8d-4a34-ae43-279affeb0465", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951754100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87b096133b2342ffa84c7c60354e4b2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4fbdfee-cb", "ovs_interfaceid": "d4fbdfee-cb2d-4fc5-a406-53e57a6fb315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG os_vif [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4fbdfee-cb, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:39 user nova-compute[73079]: INFO os_vif [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9a:a4,bridge_name='br-int',has_traffic_filtering=True,id=d4fbdfee-cb2d-4fc5-a406-53e57a6fb315,network=Network(7262461e-ad8d-4a34-ae43-279affeb0465),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4fbdfee-cb')
Aug 17 15:07:39 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Deleting instance files /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df_del
Aug 17 15:07:39 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Deletion of /opt/stack/data/nova/instances/b9099ee0-b542-41d8-8925-1473f4f821df_del complete
Aug 17 15:07:39 user nova-compute[73079]: INFO nova.compute.manager [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Acquiring lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Lock "b7fce05e-80ca-4a0f-950c-3c0933e5531a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] No waiting events found dispatching network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:39 user nova-compute[73079]: WARNING nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Received unexpected event network-vif-plugged-bd8b26ce-779d-4b58-98af-15a67ac1373d for instance with vm_state deleted and task_state None.
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-vif-unplugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] No waiting events found dispatching network-vif-unplugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-vif-unplugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Acquiring lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] Lock "b9099ee0-b542-41d8-8925-1473f4f821df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] No waiting events found dispatching network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:39 user nova-compute[73079]: WARNING nova.compute.manager [req-4461dd83-fba6-4738-81e8-1899384f98d7 req-a22b676d-76e6-475e-a584-05abc7a077c7 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received unexpected event network-vif-plugged-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 for instance with vm_state active and task_state deleting.
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:39 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Took 0.45 seconds to deallocate network for instance.
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:07:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:39 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Deleted allocations for instance b9099ee0-b542-41d8-8925-1473f4f821df
Aug 17 15:07:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-fbeaa69c-7231-4f8d-8e18-6d968ce942dd tempest-VolumesActionsTest-1667820847 tempest-VolumesActionsTest-1667820847-project-member] Lock "b9099ee0-b542-41d8-8925-1473f4f821df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.586s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:40 user nova-compute[73079]: DEBUG nova.compute.manager [req-bc44d82b-f6d5-448f-b172-fb458e175fa2 req-d678f626-a316-44e9-8d91-7111b9ce7c75 service nova] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Received event network-vif-deleted-d4fbdfee-cb2d-4fc5-a406-53e57a6fb315 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:49 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284854.321506, c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:07:49 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] VM Stopped (Lifecycle Event)
Aug 17 15:07:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8c7debbe-53d1-4453-a62c-183bb6d650af None None] [instance: c3c8e6dd-5164-4ef4-a1d1-393188ad6ce9] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:50 user nova-compute[73079]: INFO nova.compute.manager [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Terminating instance
Aug 17 15:07:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad9a36e1-612b-473e-b61e-daca04d13b61 req-a793a891-46ad-4ae1-8104-9cd6ca0efd0d service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad9a36e1-612b-473e-b61e-daca04d13b61 req-a793a891-46ad-4ae1-8104-9cd6ca0efd0d service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad9a36e1-612b-473e-b61e-daca04d13b61 req-a793a891-46ad-4ae1-8104-9cd6ca0efd0d service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ad9a36e1-612b-473e-b61e-daca04d13b61 req-a793a891-46ad-4ae1-8104-9cd6ca0efd0d service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad9a36e1-612b-473e-b61e-daca04d13b61 req-a793a891-46ad-4ae1-8104-9cd6ca0efd0d service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:50 user nova-compute[73079]: DEBUG nova.compute.manager [req-ad9a36e1-612b-473e-b61e-daca04d13b61 req-a793a891-46ad-4ae1-8104-9cd6ca0efd0d service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-unplugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:07:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Instance destroyed successfully.
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'resources' on Instance uuid 9c2a7315-c524-4c66-9018-9f760bc3f2b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-103246472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-103246472',id=39,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-gsqd8r9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:06:04Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=9c2a7315-c524-4c66-9018-9f760bc3f2b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "address": "fa:16:3e:39:e9:fe", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162abcfd-c4", "ovs_interfaceid": "162abcfd-c46e-45f8-b626-ff551ef3a40d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_vif [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap162abcfd-c4, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:07:51 user nova-compute[73079]: INFO os_vif [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:e9:fe,bridge_name='br-int',has_traffic_filtering=True,id=162abcfd-c46e-45f8-b626-ff551ef3a40d,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162abcfd-c4')
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPyJMfwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:07:51 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f682a-7e4f-4e12-a865-b9c3a3604036]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffcf15-fd34-49e3-a11d-6636c8ccd388]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:07:51 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:07:51 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:07:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:07:51 user nova-compute[73079]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 (non-flash)
Aug 17 15:07:51 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:07:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c837d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69'): ({'sde'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Removing single pathed devices sde {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e29424-21da-4676-84fc-f39332b65e26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9158ce41-79ff-408b-909b-87439f3ff4e4]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flushing IO for device /dev/sde {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f577f8d-faf0-48b7-aa3b-94fb3b0bafb4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7137f7b-a653-425c-a3af-4ac6f4e710c3]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] SCSI volumes sde have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23734316137643462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e7a58626', '/dev/disk/by-id/scsi-1SCST_BIOe7a58626-741a7d4baba1b29e') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[778844fe-3bcd-4b2e-9239-343b1c807f6e]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4011b96-28f7-47b9-b46d-5bbe7832de55]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574092a-ef8e-441c-b52e-86d3b73a52aa]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260]
Aug 17 15:07:51 user nova-compute[73079]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69, portal: 172.16.0.220,3260] successful.
Aug 17 15:07:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38f9bf35-ed69-4781-9e55-b75e4fcfac69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45804af-2147-486c-95fc-c63024f63630]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== disconnect_volume: return (271ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:07:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Deleting instance files /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6_del
Aug 17 15:07:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Deletion of /opt/stack/data/nova/instances/9c2a7315-c524-4c66-9018-9f760bc3f2b6_del complete
Aug 17 15:07:51 user nova-compute[73079]: INFO nova.compute.manager [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 17 15:07:51 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-03348411-f078-4126-b375-fcf250206cdc req-bbea0b4c-6f77-4885-9238-56c244d80995 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-deleted-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:51 user nova-compute[73079]: INFO nova.compute.manager [req-03348411-f078-4126-b375-fcf250206cdc req-bbea0b4c-6f77-4885-9238-56c244d80995 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Neutron deleted interface 162abcfd-c46e-45f8-b626-ff551ef3a40d; detaching it from the instance and deleting it from the info cache
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-03348411-f078-4126-b375-fcf250206cdc req-bbea0b4c-6f77-4885-9238-56c244d80995 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:07:51 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Took 0.51 seconds to deallocate network for instance.
Aug 17 15:07:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-03348411-f078-4126-b375-fcf250206cdc req-bbea0b4c-6f77-4885-9238-56c244d80995 service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Detach interface failed, port_id=162abcfd-c46e-45f8-b626-ff551ef3a40d, reason: Instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284857.5539856, b7fce05e-80ca-4a0f-950c-3c0933e5531a => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:07:52 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] VM Stopped (Lifecycle Event)
Aug 17 15:07:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fee295d0-4530-4892-8c74-0dd73245ca01 None None] [instance: b7fce05e-80ca-4a0f-950c-3c0933e5531a] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:07:52 user nova-compute[73079]: INFO nova.compute.manager [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Took 0.74 seconds to detach 1 volumes for instance.
Aug 17 15:07:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7085f4c-ef92-42ff-a895-c5ef266ce225 req-3d737e1f-d274-4c55-b247-7ffb666c6eab service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7085f4c-ef92-42ff-a895-c5ef266ce225 req-3d737e1f-d274-4c55-b247-7ffb666c6eab service nova] Acquiring lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7085f4c-ef92-42ff-a895-c5ef266ce225 req-3d737e1f-d274-4c55-b247-7ffb666c6eab service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7085f4c-ef92-42ff-a895-c5ef266ce225 req-3d737e1f-d274-4c55-b247-7ffb666c6eab service nova] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7085f4c-ef92-42ff-a895-c5ef266ce225 req-3d737e1f-d274-4c55-b247-7ffb666c6eab service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] No waiting events found dispatching network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:07:52 user nova-compute[73079]: WARNING nova.compute.manager [req-d7085f4c-ef92-42ff-a895-c5ef266ce225 req-3d737e1f-d274-4c55-b247-7ffb666c6eab service nova] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Received unexpected event network-vif-plugged-162abcfd-c46e-45f8-b626-ff551ef3a40d for instance with vm_state active and task_state deleting.
Aug 17 15:07:52 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:07:52 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:07:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:53 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Deleted allocations for instance 9c2a7315-c524-4c66-9018-9f760bc3f2b6
Aug 17 15:07:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7afbda4d-f70f-438c-a118-ec225f3b29ac tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "9c2a7315-c524-4c66-9018-9f760bc3f2b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.875s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:07:54 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284859.0139081, b9099ee0-b542-41d8-8925-1473f4f821df => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:07:54 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] VM Stopped (Lifecycle Event)
Aug 17 15:07:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-59932e2d-7692-4c61-8c1a-331057eb0371 None None] [instance: b9099ee0-b542-41d8-8925-1473f4f821df] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:07:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:06 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284871.0195515, 9c2a7315-c524-4c66-9018-9f760bc3f2b6 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:08:06 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] VM Stopped (Lifecycle Event)
Aug 17 15:08:06 user nova-compute[73079]: DEBUG nova.compute.manager [None req-231f4757-0f3a-48b5-9f21-d470866f000c None None] [instance: 9c2a7315-c524-4c66-9018-9f760bc3f2b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:08:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:18 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:08:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:08:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:08:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:08:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:24 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:08:25 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=25.12374496459961GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 0693416d-2ee8-4847-9249-ee10d085b3aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:08:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updating instance_info_cache with network_info: [{"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-527647ad-d7ef-456f-a03b-3c2cd7572ce4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:08:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:08:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:30 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:08:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:08:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:08:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:08:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-changed-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Refreshing instance network info cache due to event network-changed-27f04f18-ee2a-470f-91cb-9e8a7540def1. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] Acquiring lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] Acquired lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Refreshing network info cache for port 27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:37 user nova-compute[73079]: INFO nova.compute.manager [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Terminating instance
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-f94bf41a-e50a-4f3c-abb2-a5cbfe7f4434 req-71a48676-5e3e-451b-94ce-96ebd59e0907 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-vif-unplugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f94bf41a-e50a-4f3c-abb2-a5cbfe7f4434 req-71a48676-5e3e-451b-94ce-96ebd59e0907 service nova] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f94bf41a-e50a-4f3c-abb2-a5cbfe7f4434 req-71a48676-5e3e-451b-94ce-96ebd59e0907 service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f94bf41a-e50a-4f3c-abb2-a5cbfe7f4434 req-71a48676-5e3e-451b-94ce-96ebd59e0907 service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-f94bf41a-e50a-4f3c-abb2-a5cbfe7f4434 req-71a48676-5e3e-451b-94ce-96ebd59e0907 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] No waiting events found dispatching network-vif-unplugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-f94bf41a-e50a-4f3c-abb2-a5cbfe7f4434 req-71a48676-5e3e-451b-94ce-96ebd59e0907 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-vif-unplugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updated VIF entry in instance network info cache for port 27f04f18-ee2a-470f-91cb-9e8a7540def1. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG nova.network.neutron [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updating instance_info_cache with network_info: [{"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:08:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c2ad9af5-0ce6-43aa-9308-6286afc742ee req-77e430ef-3bae-419d-8b13-5375911d261a service nova] Releasing lock "refresh_cache-0693416d-2ee8-4847-9249-ee10d085b3aa" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Instance destroyed successfully.
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lazy-loading 'resources' on Instance uuid 0693416d-2ee8-4847-9249-ee10d085b3aa {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-931083762',display_name='tempest-TestVolumeBootPattern-server-931083762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-931083762',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkD2R+W61A0lBO9ij5bRZ+jPPETUVveGFFzVe4GFTgSWbvwnwup90gncmrJQ3kywdNcWfXGjnRX40gFJcNF4mFvLqOqUw9nBmJl+yw5Be69jsCuQ/KYho2t0ghvitjOBg==',key_name='tempest-TestVolumeBootPattern-943464984',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9478b753e2040e799f28e18c5a82223',ramdisk_id='',reservation_id='r-aghn2lc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1112851866',owner_user_name='tempest-TestVolumeBootPattern-1112851866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:03:52Z,user_data=None,user_id='722f38129c96487b8331cde0ab317832',uuid=0693416d-2ee8-4847-9249-ee10d085b3aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converting VIF {"id": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "address": "fa:16:3e:39:f6:c8", "network": {"id": "2e37e58b-fce6-4fa7-a76c-2e732c426aff", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1829630028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9478b753e2040e799f28e18c5a82223", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f04f18-ee", "ovs_interfaceid": "27f04f18-ee2a-470f-91cb-9e8a7540def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_vif [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27f04f18-ee, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:38 user nova-compute[73079]: INFO os_vif [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:f6:c8,bridge_name='br-int',has_traffic_filtering=True,id=27f04f18-ee2a-470f-91cb-9e8a7540def1,network=Network(2e37e58b-fce6-4fa7-a76c-2e732c426aff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f04f18-ee')
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCalKBXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:08:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e3df8-903e-4b92-975f-f04411a8d382]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b564ff-d096-44b5-aab3-c51633fe9550]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:08:38 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:08:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:08:38 user nova-compute[73079]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa (non-flash)
Aug 17 15:08:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f45d2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fef9d6-46e4-4730-af59-4c386d25456a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[50faa37a-54ca-428f-83e3-2b0cacdf2d6f]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[093df005-60ea-4d43-9d36-0472b89b123f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[925ff699-4393-4279-b52c-b44172778662]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26535366163316366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1b940', '/dev/disk/by-id/scsi-1SCST_BIOe1b940-e56ac1cf8e149691') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47b8d9-c242-4caa-8bea-05ea9ddcbf64]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[456f4c2d-8d7c-469b-903d-2ce44f8599b3]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a70cd7-5339-4e56-8146-60a22ce13f18]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260]
Aug 17 15:08:38 user nova-compute[73079]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa, portal: 172.16.0.220,3260] successful.
Aug 17 15:08:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7680a124-ef70-4f8c-8b3f-fd9cc24f42fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152dcc3-856a-49a1-bf2f-96351dae7114]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] <== disconnect_volume: return (303ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:08:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Deleting instance files /opt/stack/data/nova/instances/0693416d-2ee8-4847-9249-ee10d085b3aa_del
Aug 17 15:08:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Deletion of /opt/stack/data/nova/instances/0693416d-2ee8-4847-9249-ee10d085b3aa_del complete
Aug 17 15:08:38 user nova-compute[73079]: INFO nova.compute.manager [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 15:08:38 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:08:38 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:08:39 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:08:39 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Took 1.10 seconds to deallocate network for instance.
Aug 17 15:08:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-030c7a97-c835-410e-b67e-e862811b7613 req-bf926378-ccfe-4952-bff0-884d35040375 service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-vif-deleted-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-dfedc785-2aca-4799-9326-bedb621369a7 req-776d0fa9-2fcd-4a04-9179-7a13edd213cf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received event network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dfedc785-2aca-4799-9326-bedb621369a7 req-776d0fa9-2fcd-4a04-9179-7a13edd213cf service nova] Acquiring lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dfedc785-2aca-4799-9326-bedb621369a7 req-776d0fa9-2fcd-4a04-9179-7a13edd213cf service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dfedc785-2aca-4799-9326-bedb621369a7 req-776d0fa9-2fcd-4a04-9179-7a13edd213cf service nova] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-dfedc785-2aca-4799-9326-bedb621369a7 req-776d0fa9-2fcd-4a04-9179-7a13edd213cf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] No waiting events found dispatching network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:08:39 user nova-compute[73079]: WARNING nova.compute.manager [req-dfedc785-2aca-4799-9326-bedb621369a7 req-776d0fa9-2fcd-4a04-9179-7a13edd213cf service nova] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Received unexpected event network-vif-plugged-27f04f18-ee2a-470f-91cb-9e8a7540def1 for instance with vm_state active and task_state deleting.
Aug 17 15:08:40 user nova-compute[73079]: INFO nova.compute.manager [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 15:08:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:40 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:08:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:08:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:40 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Deleted allocations for instance 0693416d-2ee8-4847-9249-ee10d085b3aa
Aug 17 15:08:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f28aec64-017d-47fb-b8c1-d8bb5f6ad488 tempest-TestVolumeBootPattern-1112851866 tempest-TestVolumeBootPattern-1112851866-project-member] Lock "0693416d-2ee8-4847-9249-ee10d085b3aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.464s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:41 user nova-compute[73079]: INFO nova.compute.manager [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Terminating instance
Aug 17 15:08:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-bdaf18a3-fa22-4ece-afd4-21495026a5eb req-e7cc9973-92f3-4c15-a7c2-6192a9e500c0 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-vif-unplugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bdaf18a3-fa22-4ece-afd4-21495026a5eb req-e7cc9973-92f3-4c15-a7c2-6192a9e500c0 service nova] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bdaf18a3-fa22-4ece-afd4-21495026a5eb req-e7cc9973-92f3-4c15-a7c2-6192a9e500c0 service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bdaf18a3-fa22-4ece-afd4-21495026a5eb req-e7cc9973-92f3-4c15-a7c2-6192a9e500c0 service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-bdaf18a3-fa22-4ece-afd4-21495026a5eb req-e7cc9973-92f3-4c15-a7c2-6192a9e500c0 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] No waiting events found dispatching network-vif-unplugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-bdaf18a3-fa22-4ece-afd4-21495026a5eb req-e7cc9973-92f3-4c15-a7c2-6192a9e500c0 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-vif-unplugged-051a4ec3-8620-482d-aa0f-99d3c44170cb for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Instance destroyed successfully.
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'resources' on Instance uuid 527647ad-d7ef-456f-a03b-3c2cd7572ce4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1179017841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1179017841',id=34,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-qz5stgv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:01:15Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=527647ad-d7ef-456f-a03b-3c2cd7572ce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "address": "fa:16:3e:1e:85:e8", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051a4ec3-86", "ovs_interfaceid": "051a4ec3-8620-482d-aa0f-99d3c44170cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG os_vif [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap051a4ec3-86, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:42 user nova-compute[73079]: INFO os_vif [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:85:e8,bridge_name='br-int',has_traffic_filtering=True,id=051a4ec3-8620-482d-aa0f-99d3c44170cb,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051a4ec3-86')
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Deleting instance files /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4_del
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Deletion of /opt/stack/data/nova/instances/527647ad-d7ef-456f-a03b-3c2cd7572ce4_del complete
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.compute.manager [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 15:08:42 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Took 0.57 seconds to deallocate network for instance.
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-9f9a4cfe-8a77-4640-a55a-1a7b72906f84 req-b6b07db1-32e4-4125-b79a-edf78e31b431 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-vif-deleted-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.compute.manager [req-9f9a4cfe-8a77-4640-a55a-1a7b72906f84 req-b6b07db1-32e4-4125-b79a-edf78e31b431 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Neutron deleted interface 051a4ec3-8620-482d-aa0f-99d3c44170cb; detaching it from the instance and deleting it from the info cache
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-9f9a4cfe-8a77-4640-a55a-1a7b72906f84 req-b6b07db1-32e4-4125-b79a-edf78e31b431 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-9f9a4cfe-8a77-4640-a55a-1a7b72906f84 req-b6b07db1-32e4-4125-b79a-edf78e31b431 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Detach interface failed, port_id=051a4ec3-8620-482d-aa0f-99d3c44170cb, reason: Instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:08:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:42 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Deleted allocations for instance 527647ad-d7ef-456f-a03b-3c2cd7572ce4
Aug 17 15:08:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f9992534-d129-439b-9d44-d9f7cd0c2154 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-0ab2b1ad-d9db-4665-b87d-e9a52bf0291a req-d02b786d-0952-4a0f-bd23-e33ef0d6c900 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received event network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:08:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0ab2b1ad-d9db-4665-b87d-e9a52bf0291a req-d02b786d-0952-4a0f-bd23-e33ef0d6c900 service nova] Acquiring lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:08:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0ab2b1ad-d9db-4665-b87d-e9a52bf0291a req-d02b786d-0952-4a0f-bd23-e33ef0d6c900 service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:08:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0ab2b1ad-d9db-4665-b87d-e9a52bf0291a req-d02b786d-0952-4a0f-bd23-e33ef0d6c900 service nova] Lock "527647ad-d7ef-456f-a03b-3c2cd7572ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:08:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-0ab2b1ad-d9db-4665-b87d-e9a52bf0291a req-d02b786d-0952-4a0f-bd23-e33ef0d6c900 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] No waiting events found dispatching network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:08:43 user nova-compute[73079]: WARNING nova.compute.manager [req-0ab2b1ad-d9db-4665-b87d-e9a52bf0291a req-d02b786d-0952-4a0f-bd23-e33ef0d6c900 service nova] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Received unexpected event network-vif-plugged-051a4ec3-8620-482d-aa0f-99d3c44170cb for instance with vm_state deleted and task_state None.
Aug 17 15:08:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:53 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284918.2537668, 0693416d-2ee8-4847-9249-ee10d085b3aa => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:08:53 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] VM Stopped (Lifecycle Event)
Aug 17 15:08:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-7bebeb24-f558-4bfb-a7ad-5650345d1934 None None] [instance: 0693416d-2ee8-4847-9249-ee10d085b3aa] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284922.0082083, 527647ad-d7ef-456f-a03b-3c2cd7572ce4 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:08:57 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] VM Stopped (Lifecycle Event)
Aug 17 15:08:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40d83d05-eac9-4592-88de-880d23486551 None None] [instance: 527647ad-d7ef-456f-a03b-3c2cd7572ce4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:08:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:09:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:09:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:09:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:09:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:09:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:09:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:09:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:09:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:09:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:09:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:09:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:09:25 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:26 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:09:26 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=25.246726989746094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cf693095-4aa8-4b88-b9bd-fe9026c71d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:09:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:09:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:09:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:31 user nova-compute[73079]: INFO nova.compute.manager [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Terminating instance
Aug 17 15:09:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-951f565d-e04f-4297-9d14-aa21c5dd2108 req-3a7e8873-b8f0-4b66-918d-2c069f79e0e9 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-951f565d-e04f-4297-9d14-aa21c5dd2108 req-3a7e8873-b8f0-4b66-918d-2c069f79e0e9 service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-951f565d-e04f-4297-9d14-aa21c5dd2108 req-3a7e8873-b8f0-4b66-918d-2c069f79e0e9 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-951f565d-e04f-4297-9d14-aa21c5dd2108 req-3a7e8873-b8f0-4b66-918d-2c069f79e0e9 service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-951f565d-e04f-4297-9d14-aa21c5dd2108 req-3a7e8873-b8f0-4b66-918d-2c069f79e0e9 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:09:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-951f565d-e04f-4297-9d14-aa21c5dd2108 req-3a7e8873-b8f0-4b66-918d-2c069f79e0e9 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-unplugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Instance destroyed successfully.
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'resources' on Instance uuid 168eb979-11c1-4643-a2e2-b160cbc5f150 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1720781670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1720781670',id=26,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:55:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-cuol53ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:57:33Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=168eb979-11c1-4643-a2e2-b160cbc5f150,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "address": "fa:16:3e:0d:99:f0", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8bcd51-97", "ovs_interfaceid": "6f8bcd51-97dc-4aef-980d-c3288e4f78ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_vif [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f8bcd51-97, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:32 user nova-compute[73079]: INFO os_vif [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:99:f0,bridge_name='br-int',has_traffic_filtering=True,id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8bcd51-97')
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYJnThqC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:09:32 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d89ac2-aee4-4901-b25b-16debec9b2d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec98ab7e-9b38-45af-8d24-fe69e95515eb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:09:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 (non-flash)
Aug 17 15:09:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e83dd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb3309-c3da-47e9-83c3-77b7effd9d82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b586eca5-a3b5-4853-bf13-6fbfc1e893eb]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9d0ca0-a74e-4fc6-88f8-b7d8f4195874]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425e0c2-c68f-43db-8494-52b728bcb71b]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8043716-b989-46f7-95b0-09c208a84b1c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8708a4-6a82-4a92-9016-f69841f116ee]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260]
Aug 17 15:09:32 user nova-compute[73079]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0, portal: 172.16.0.220,3260] successful.
Aug 17 15:09:32 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:353cf1f3-e72b-47e3-8f9a-784d15af77e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a3d89-11c9-4321-8f1d-2c31d04466dc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] <== disconnect_volume: return (289ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:09:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Deleting instance files /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150_del
Aug 17 15:09:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Deletion of /opt/stack/data/nova/instances/168eb979-11c1-4643-a2e2-b160cbc5f150_del complete
Aug 17 15:09:32 user nova-compute[73079]: INFO nova.compute.manager [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 15:09:32 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:09:32 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:09:33 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:09:33 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Took 0.54 seconds to deallocate network for instance.
Aug 17 15:09:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-ce401ce1-737c-4535-aaa3-365fe264c51d req-a5ac22c6-1fd2-4a1e-bc24-c1cbba34e6d4 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-deleted-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:09:33 user nova-compute[73079]: INFO nova.compute.manager [req-ce401ce1-737c-4535-aaa3-365fe264c51d req-a5ac22c6-1fd2-4a1e-bc24-c1cbba34e6d4 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Neutron deleted interface 6f8bcd51-97dc-4aef-980d-c3288e4f78ac; detaching it from the instance and deleting it from the info cache
Aug 17 15:09:33 user nova-compute[73079]: DEBUG nova.network.neutron [req-ce401ce1-737c-4535-aaa3-365fe264c51d req-a5ac22c6-1fd2-4a1e-bc24-c1cbba34e6d4 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:09:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-ce401ce1-737c-4535-aaa3-365fe264c51d req-a5ac22c6-1fd2-4a1e-bc24-c1cbba34e6d4 service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Detach interface failed, port_id=6f8bcd51-97dc-4aef-980d-c3288e4f78ac, reason: Instance 168eb979-11c1-4643-a2e2-b160cbc5f150 could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-43a5826f-1f65-4354-9974-9facacc4a679 req-609aba42-d1e0-4d2d-a946-16be559baffe service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-43a5826f-1f65-4354-9974-9facacc4a679 req-609aba42-d1e0-4d2d-a946-16be559baffe service nova] Acquiring lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-43a5826f-1f65-4354-9974-9facacc4a679 req-609aba42-d1e0-4d2d-a946-16be559baffe service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-43a5826f-1f65-4354-9974-9facacc4a679 req-609aba42-d1e0-4d2d-a946-16be559baffe service nova] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-43a5826f-1f65-4354-9974-9facacc4a679 req-609aba42-d1e0-4d2d-a946-16be559baffe service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] No waiting events found dispatching network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:09:34 user nova-compute[73079]: WARNING nova.compute.manager [req-43a5826f-1f65-4354-9974-9facacc4a679 req-609aba42-d1e0-4d2d-a946-16be559baffe service nova] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Received unexpected event network-vif-plugged-6f8bcd51-97dc-4aef-980d-c3288e4f78ac for instance with vm_state active and task_state deleting.
Aug 17 15:09:34 user nova-compute[73079]: INFO nova.compute.manager [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Took 0.93 seconds to detach 1 volumes for instance.
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:34 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Deleted allocations for instance 168eb979-11c1-4643-a2e2-b160cbc5f150
Aug 17 15:09:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-630fa24b-cbc7-4a85-91fe-9645ec44d9c5 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "168eb979-11c1-4643-a2e2-b160cbc5f150" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.088s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:09:40 user nova-compute[73079]: INFO nova.compute.claims [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Claim successful on node user
Aug 17 15:09:40 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:09:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:09:41 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:09:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:09:41 user nova-compute[73079]: INFO nova.virt.block_device [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Booting with volume dc19bfbd-40d0-4dcc-8e52-523944713606 at /dev/vda
Aug 17 15:09:41 user nova-compute[73079]: DEBUG os_brick.utils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG nova.policy [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcfb392dca9d4008b1ca9655cedaef6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13613dce4b924a33b76cdfac1a23cb3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0cfd68-7028-479e-a163-ee617b71f16e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7766823-9be9-4692-9295-e68855a1aa27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d65afa-fb70-4a11-8e47-7449b9ec0ec5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c6d49-c65b-478b-bb98-a9cc75e66894]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:09:41 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:09:41 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60f77b2-8932-425a-b130-c5869e84146c]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG os_brick.utils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:09:41 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating existing volume attachment record: 26fb17f8-efa9-45a6-af85-04a47587a0d3 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:09:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Successfully created port: 12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:09:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Successfully updated port: 12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-changed-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Refreshing instance network info cache due to event network-changed-12be255e-46c2-464d-a90f-36885eb46551. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance network_info: |[{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Refreshing network info cache for port 12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updated VIF entry in instance network info cache for port 12be255e-46c2-464d-a90f-36885eb46551. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:09:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1b79c014-4f23-4631-82ac-7d206a136ef9 req-180b23e8-713c-4331-b9f7-967bb1b69023 service nova] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:09:47 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692284972.3992712, 168eb979-11c1-4643-a2e2-b160cbc5f150 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:09:47 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] VM Stopped (Lifecycle Event)
Aug 17 15:09:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-fe9c346c-af7e-45da-bc3a-77181875354b None None] [instance: 168eb979-11c1-4643-a2e2-b160cbc5f150] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:09:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:09:51 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Creating image(s)
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Ensure instance console log exists: /opt/stack/data/nova/instances/045fac1e-d82a-4f51-8793-e047277572c4/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Start _get_guest_xml network_info=[{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': '26fb17f8-efa9-45a6-af85-04a47587a0d3', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '045fac1e-d82a-4f51-8793-e047277572c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc19bfbd-40d0-4dcc-8e52-523944713606', 'serial': 'dc19bfbd-40d0-4dcc-8e52-523944713606'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:09:51 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:09:51 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:09:51 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:09:51 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:09:51 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f99c901-e83b-4597-9f02-09166c62f110]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:09:51 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1e1cf-dad4-4d72-b283-c4be4a176e16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606] added
Aug 17 15:09:51 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ebec4d-3597-49e8-9309-92fbc9d8db27]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a315dac1-1c9d-460e-b536-699ffb41cb2e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTBGMmjJ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTBGMmjJ" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a4441-a4d8-4970-bcf8-23d2e66d8d13]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTBGMmjJ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b114b64-d233-41db-afef-5cb80b15e948]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab381f0c-124e-47ca-a0a5-8a76661902a3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:09:51 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:09:51 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:09:51 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:09:51 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:09:51 user nova-compute[73079]: 
Aug 17 15:09:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6495c-a5c4-408f-a7f1-2e0a84c29daa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]
Aug 17 15:09:52 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.
Aug 17 15:09:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d094044c-eb4f-4226-8472-a2994d126570]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8337a686-9925-4d19-8db2-63c385d51a78]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:09:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:09:52 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493fc6a-ddd9-48d8-9dc2-d652b425ed0a]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:09:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23431353066333434', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431353066333434', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1087027143',display_name='tempest-ServerActionsTestOtherA-server-1087027143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1087027143',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-jdouwmzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=045fac1e-d82a-4f51-8793-e047277572c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_devices' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:09:53 user nova-compute[73079]:   <uuid>045fac1e-d82a-4f51-8793-e047277572c4</uuid>
Aug 17 15:09:53 user nova-compute[73079]:   <name>instance-0000002c</name>
Aug 17 15:09:53 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:09:53 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:09:53 user nova-compute[73079]:   <metadata>
Aug 17 15:09:53 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:09:53 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:09:53 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherA-server-1087027143</nova:name>
Aug 17 15:09:53 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:09:51</nova:creationTime>
Aug 17 15:09:53 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:09:53 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:09:53 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:09:53 user nova-compute[73079]:       <nova:owner>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:user uuid="bcfb392dca9d4008b1ca9655cedaef6c">tempest-ServerActionsTestOtherA-1400100504-project-member</nova:user>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:project uuid="13613dce4b924a33b76cdfac1a23cb3c">tempest-ServerActionsTestOtherA-1400100504</nova:project>
Aug 17 15:09:53 user nova-compute[73079]:       </nova:owner>
Aug 17 15:09:53 user nova-compute[73079]:       <nova:ports>
Aug 17 15:09:53 user nova-compute[73079]:         <nova:port uuid="12be255e-46c2-464d-a90f-36885eb46551">
Aug 17 15:09:53 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 15:09:53 user nova-compute[73079]:         </nova:port>
Aug 17 15:09:53 user nova-compute[73079]:       </nova:ports>
Aug 17 15:09:53 user nova-compute[73079]:     </nova:instance>
Aug 17 15:09:53 user nova-compute[73079]:   </metadata>
Aug 17 15:09:53 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:09:53 user nova-compute[73079]:     <system>
Aug 17 15:09:53 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:09:53 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:09:53 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:09:53 user nova-compute[73079]:       <entry name="serial">045fac1e-d82a-4f51-8793-e047277572c4</entry>
Aug 17 15:09:53 user nova-compute[73079]:       <entry name="uuid">045fac1e-d82a-4f51-8793-e047277572c4</entry>
Aug 17 15:09:53 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:09:53 user nova-compute[73079]:     </system>
Aug 17 15:09:53 user nova-compute[73079]:   </sysinfo>
Aug 17 15:09:53 user nova-compute[73079]:   <os>
Aug 17 15:09:53 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:09:53 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:09:53 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:09:53 user nova-compute[73079]:   </os>
Aug 17 15:09:53 user nova-compute[73079]:   <features>
Aug 17 15:09:53 user nova-compute[73079]:     <acpi/>
Aug 17 15:09:53 user nova-compute[73079]:     <apic/>
Aug 17 15:09:53 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:09:53 user nova-compute[73079]:   </features>
Aug 17 15:09:53 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:09:53 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:09:53 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:09:53 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:09:53 user nova-compute[73079]:   </clock>
Aug 17 15:09:53 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:09:53 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:09:53 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:09:53 user nova-compute[73079]:   </cpu>
Aug 17 15:09:53 user nova-compute[73079]:   <devices>
Aug 17 15:09:53 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:09:53 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:09:53 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 15:09:53 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:09:53 user nova-compute[73079]:       <serial>dc19bfbd-40d0-4dcc-8e52-523944713606</serial>
Aug 17 15:09:53 user nova-compute[73079]:     </disk>
Aug 17 15:09:53 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:09:53 user nova-compute[73079]:       <mac address="fa:16:3e:57:9e:8b"/>
Aug 17 15:09:53 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:09:53 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:09:53 user nova-compute[73079]:       <target dev="tap12be255e-46"/>
Aug 17 15:09:53 user nova-compute[73079]:     </interface>
Aug 17 15:09:53 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:09:53 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/045fac1e-d82a-4f51-8793-e047277572c4/console.log" append="off"/>
Aug 17 15:09:53 user nova-compute[73079]:     </serial>
Aug 17 15:09:53 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:09:53 user nova-compute[73079]:     <video>
Aug 17 15:09:53 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:09:53 user nova-compute[73079]:     </video>
Aug 17 15:09:53 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:09:53 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:09:53 user nova-compute[73079]:     </rng>
Aug 17 15:09:53 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:09:53 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:09:53 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:09:53 user nova-compute[73079]:     </memballoon>
Aug 17 15:09:53 user nova-compute[73079]:   </devices>
Aug 17 15:09:53 user nova-compute[73079]: </domain>
Aug 17 15:09:53 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1087027143',display_name='tempest-ServerActionsTestOtherA-server-1087027143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1087027143',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-jdouwmzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=045fac1e-d82a-4f51-8793-e047277572c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG os_vif [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12be255e-46, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12be255e-46, col_values=(('external_ids', {'iface-id': '12be255e-46c2-464d-a90f-36885eb46551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:9e:8b', 'vm-uuid': '045fac1e-d82a-4f51-8793-e047277572c4'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:53 user nova-compute[73079]: INFO os_vif [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46')
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:09:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No VIF found with MAC fa:16:3e:57:9e:8b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2ba0a40-f995-4732-972c-341a9105ca79 req-000da35a-21f5-440d-8322-504938dbed03 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2ba0a40-f995-4732-972c-341a9105ca79 req-000da35a-21f5-440d-8322-504938dbed03 service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2ba0a40-f995-4732-972c-341a9105ca79 req-000da35a-21f5-440d-8322-504938dbed03 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2ba0a40-f995-4732-972c-341a9105ca79 req-000da35a-21f5-440d-8322-504938dbed03 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2ba0a40-f995-4732-972c-341a9105ca79 req-000da35a-21f5-440d-8322-504938dbed03 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:09:54 user nova-compute[73079]: WARNING nova.compute.manager [req-a2ba0a40-f995-4732-972c-341a9105ca79 req-000da35a-21f5-440d-8322-504938dbed03 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state building and task_state spawning.
Aug 17 15:09:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284996.7268603, 045fac1e-d82a-4f51-8793-e047277572c4 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] VM Resumed (Lifecycle Event)
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance spawned successfully.
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-86520337-ea12-4482-8b0a-851e790f4724 req-0b48e968-1f0d-42c3-8852-acbee93e166c service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-86520337-ea12-4482-8b0a-851e790f4724 req-0b48e968-1f0d-42c3-8852-acbee93e166c service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-86520337-ea12-4482-8b0a-851e790f4724 req-0b48e968-1f0d-42c3-8852-acbee93e166c service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-86520337-ea12-4482-8b0a-851e790f4724 req-0b48e968-1f0d-42c3-8852-acbee93e166c service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-86520337-ea12-4482-8b0a-851e790f4724 req-0b48e968-1f0d-42c3-8852-acbee93e166c service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:09:56 user nova-compute[73079]: WARNING nova.compute.manager [req-86520337-ea12-4482-8b0a-851e790f4724 req-0b48e968-1f0d-42c3-8852-acbee93e166c service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state building and task_state spawning.
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692284996.730231, 045fac1e-d82a-4f51-8793-e047277572c4 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] VM Started (Lifecycle Event)
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 17 15:09:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:09:56 user nova-compute[73079]: INFO nova.compute.manager [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Took 16.19 seconds to build instance.
Aug 17 15:09:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f107fc5f-7562-4790-9dff-e0973f665af5 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.289s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:09:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:09:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:22 user nova-compute[73079]: INFO nova.compute.manager [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Terminating instance
Aug 17 15:10:22 user nova-compute[73079]: DEBUG nova.compute.manager [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-9542e841-1aab-4704-aaf9-e3a5dae9a2de req-13aae147-8d31-4886-bf15-98fb864342f3 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-vif-unplugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9542e841-1aab-4704-aaf9-e3a5dae9a2de req-13aae147-8d31-4886-bf15-98fb864342f3 service nova] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9542e841-1aab-4704-aaf9-e3a5dae9a2de req-13aae147-8d31-4886-bf15-98fb864342f3 service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9542e841-1aab-4704-aaf9-e3a5dae9a2de req-13aae147-8d31-4886-bf15-98fb864342f3 service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-9542e841-1aab-4704-aaf9-e3a5dae9a2de req-13aae147-8d31-4886-bf15-98fb864342f3 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] No waiting events found dispatching network-vif-unplugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:10:22 user nova-compute[73079]: DEBUG nova.compute.manager [req-9542e841-1aab-4704-aaf9-e3a5dae9a2de req-13aae147-8d31-4886-bf15-98fb864342f3 service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-vif-unplugged-f1d8de62-fa52-4c8a-90c9-f147cababaae for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:10:23 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Instance destroyed successfully.
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lazy-loading 'resources' on Instance uuid cf693095-4aa8-4b88-b9bd-fe9026c71d28 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1972411876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1972411876',id=19,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0edd4ad5f2eb4e728a71908d32d353d5',ramdisk_id='',reservation_id='r-3ky599w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:52:43Z,user_data=None,user_id='5f67004af6654b5d80924a5c502a74f2',uuid=cf693095-4aa8-4b88-b9bd-fe9026c71d28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converting VIF {"id": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "address": "fa:16:3e:c5:91:62", "network": {"id": "d6405516-4320-4453-8d62-987c8172dac4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-971250275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0edd4ad5f2eb4e728a71908d32d353d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d8de62-fa", "ovs_interfaceid": "f1d8de62-fa52-4c8a-90c9-f147cababaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG os_vif [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1d8de62-fa, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:10:23 user nova-compute[73079]: INFO os_vif [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:91:62,bridge_name='br-int',has_traffic_filtering=True,id=f1d8de62-fa52-4c8a-90c9-f147cababaae,network=Network(d6405516-4320-4453-8d62-987c8172dac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d8de62-fa')
Aug 17 15:10:23 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Deleting instance files /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28_del
Aug 17 15:10:23 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Deletion of /opt/stack/data/nova/instances/cf693095-4aa8-4b88-b9bd-fe9026c71d28_del complete
Aug 17 15:10:23 user nova-compute[73079]: INFO nova.compute.manager [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 17 15:10:23 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:10:23 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Took 0.53 seconds to deallocate network for instance.
Aug 17 15:10:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:10:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:23 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Deleted allocations for instance cf693095-4aa8-4b88-b9bd-fe9026c71d28
Aug 17 15:10:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-749b4c59-70d0-4ece-9b1d-1b9f793c2694 tempest-ServerBootFromVolumeStableRescueTest-2072772980 tempest-ServerBootFromVolumeStableRescueTest-2072772980-project-member] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.542s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:10:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] Acquiring lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] Lock "cf693095-4aa8-4b88-b9bd-fe9026c71d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] No waiting events found dispatching network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:10:24 user nova-compute[73079]: WARNING nova.compute.manager [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received unexpected event network-vif-plugged-f1d8de62-fa52-4c8a-90c9-f147cababaae for instance with vm_state deleted and task_state None.
Aug 17 15:10:24 user nova-compute[73079]: DEBUG nova.compute.manager [req-574271a1-da0e-46f2-96e0-49c5f67c4820 req-5985a626-d2c7-4cb0-8867-e14d7741619e service nova] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Received event network-vif-deleted-f1d8de62-fa52-4c8a-90c9-f147cababaae {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:10:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:10:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:28 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:10:28 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=25.360836029052734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 045fac1e-d82a-4f51-8793-e047277572c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:10:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:10:29 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:10:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:10:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:10:30 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:10:30 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:10:38 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692285023.0991385, cf693095-4aa8-4b88-b9bd-fe9026c71d28 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:10:38 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] VM Stopped (Lifecycle Event)
Aug 17 15:10:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b628db5c-27f0-41b5-ba4f-2e735150aa35 None None] [instance: cf693095-4aa8-4b88-b9bd-fe9026c71d28] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:10:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:10:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:10:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:10:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:10:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:10:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:10:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:14 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:11:25 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:11:29 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:11:29 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.359554290771484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 045fac1e-d82a-4f51-8793-e047277572c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:11:30 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:30 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:30 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:11:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:11:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:11:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-changed-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Refreshing instance network info cache due to event network-changed-bae76952-ee78-41c5-8587-39aa52f950f4. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:11:31 user nova-compute[73079]: DEBUG nova.network.neutron [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Refreshing network info cache for port bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:11:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated VIF entry in instance network info cache for port bae76952-ee78-41c5-8587-39aa52f950f4. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:11:32 user nova-compute[73079]: DEBUG nova.network.neutron [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:11:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e32f0ba8-720a-4b42-a69e-24fad7403e98 req-4316d4d1-c34c-4dfd-97da-99249908febf service nova] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Stashing vm_state: active {{(pid=73079) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_requests' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:11:33 user nova-compute[73079]: INFO nova.compute.claims [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Claim successful on node user
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'resources' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'pci_devices' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:11:33 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating resource usage from migration 4ea36590-e0cc-48bf-8d65-33cb44e63fc2
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.274s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:33 user nova-compute[73079]: INFO nova.compute.manager [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Migrating
Aug 17 15:11:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-changed-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG nova.compute.manager [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Refreshing instance network info cache due to event network-changed-12be255e-46c2-464d-a90f-36885eb46551. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:11:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Refreshing network info cache for port 12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Starting migrate_disk_and_power_off {{(pid=73079) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updated VIF entry in instance network info cache for port 12be255e-46c2-464d-a90f-36885eb46551. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG nova.network.neutron [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:11:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-83e1a985-e700-4eed-966e-6c5b071c07ed req-6ded4bc1-8da4-4739-a027-00cb88f60498 service nova] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:11:35 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance destroyed successfully.
Aug 17 15:11:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1087027143',display_name='tempest-ServerActionsTestOtherA-server-1087027143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1087027143',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:09:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-jdouwmzd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=045fac1e-d82a-4f51-8793-e047277572c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12be255e-46, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:35 user nova-compute[73079]: INFO os_vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46')
Aug 17 15:11:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:11:35 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c48cc8-1ef6-416b-ae30-90a3d1da691c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bc15bc-2138-4075-88f1-1b4ea8a23ad6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:11:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:11:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c8406d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9379ed1-a8a3-42fd-afad-28c199017943]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4460b-ce8d-4f70-9731-ac81655bd35b]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4649ec7f-c84d-46bb-9f77-0faf35a921de]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab894f9-a690-4946-abd4-773bba6e3ba5]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23431353066333434', '/dev/disk/by-id/scsi-1SCST_BIO434ceaf5-4150f344ff4c8e79', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_434ceaf5') {{(pid=84615) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[387fca4c-74bb-420d-aa72-757e183ef396]: (4, None) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4b4a1-c14b-49c7-9c50-afd7a13395a9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3027d5a4-0d24-4566-b0b3-2d6d59bac182]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]
Aug 17 15:11:35 user nova-compute[73079]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.
Aug 17 15:11:35 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb87b03-1aa5-4289-a08a-84d2a26a58d8]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== disconnect_volume: return (278ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:11:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-unplugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-unplugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:11:36 user nova-compute[73079]: WARNING nova.compute.manager [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-unplugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state active and task_state resize_migrating.
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.compute.manager [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:11:36 user nova-compute[73079]: WARNING nova.compute.manager [req-dffe8c61-6e6a-4b99-8e19-f67aa7f8b558 req-155e59fd-0fb7-4279-8951-32ccaaaf4a78 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state active and task_state resize_migrating.
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Port 12be255e-46c2-464d-a90f-36885eb46551 binding to destination host user is already ACTIVE {{(pid=73079) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:11:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG os_brick.utils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57bf01f-9f05-44fe-b5b4-11b66dc635a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[13098db2-c9c5-4f07-b5c8-43d448d584bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5482f53a-dcd5-489b-ad43-92129d293e24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44d2f54-a0d3-4a31-828a-deff74ebcdf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:11:37 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:11:37 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e58857-4a05-475d-bb80-0550d28cd406]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:11:37 user nova-compute[73079]: DEBUG os_brick.utils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:11:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:11:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:11:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:11:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692285095.0289314, 045fac1e-d82a-4f51-8793-e047277572c4 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:11:50 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] VM Stopped (Lifecycle Event)
Aug 17 15:11:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3df5cfa-6324-401e-bf92-2ae7f47f23a4 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a3df5cfa-6324-401e-bf92-2ae7f47f23a4 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:11:50 user nova-compute[73079]: INFO nova.compute.manager [None req-a3df5cfa-6324-401e-bf92-2ae7f47f23a4 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Starting finish_migration {{(pid=73079) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 15:11:53 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Creating image(s)
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Did not create local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Ensure instance console log exists: /opt/stack/data/nova/instances/045fac1e-d82a-4f51-8793-e047277572c4/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Start _get_guest_xml network_info=[{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'attachment_id': 'e6e9eb37-42f6-47ed-a6aa-bf6fd3328a06', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '045fac1e-d82a-4f51-8793-e047277572c4', 'attached_at': '2023-08-17T15:11:53.000000', 'detached_at': '', 'volume_id': 'dc19bfbd-40d0-4dcc-8e52-523944713606', 'serial': 'dc19bfbd-40d0-4dcc-8e52-523944713606'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:11:53 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:11:53 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'vcpu_model' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:11:53 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:11:53 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:11:53 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8cc39-5b98-4177-934a-eaccf092c153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:11:53 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[69527875-be76-46bf-a2cb-e18a33b9aaa4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606] added
Aug 17 15:11:53 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d50379-120f-402d-b94a-697b63623132]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2fdd1-5820-4fed-bd26-c266e2247cdd]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTBGMmjJ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pTBGMmjJ" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[951981c6-5447-45cf-95f3-afb3e5b3b72b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pTBGMmjJ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[30372875-af08-4783-825c-60b8ca2d69b1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac899e32-0f50-4d52-b711-49ee4eb93b12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:11:53 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:11:53 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:11:53 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:11:53 user nova-compute[73079]: 
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa79caae-2041-497f-8f95-cbb14755c17d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]
Aug 17 15:11:53 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.
Aug 17 15:11:53 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c509032e-924c-4ce0-9d6a-4c8397e6795c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aae697-9d42-4236-a734-fc4ade3858df]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:11:53 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:11:53 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5cade8-40c4-45ca-93f7-b0ed12cb7699]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:11:53 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23431353066333434', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431353066333434', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1087027143',display_name='tempest-ServerActionsTestOtherA-server-1087027143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1087027143',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:09:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-jdouwmzd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=045fac1e-d82a-4f51-8793-e047277572c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:11:54 user nova-compute[73079]:   <uuid>045fac1e-d82a-4f51-8793-e047277572c4</uuid>
Aug 17 15:11:54 user nova-compute[73079]:   <name>instance-0000002c</name>
Aug 17 15:11:54 user nova-compute[73079]:   <memory>2097152</memory>
Aug 17 15:11:54 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:11:54 user nova-compute[73079]:   <metadata>
Aug 17 15:11:54 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:11:54 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:11:54 user nova-compute[73079]:       <nova:name>tempest-ServerActionsTestOtherA-server-1087027143</nova:name>
Aug 17 15:11:54 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:11:53</nova:creationTime>
Aug 17 15:11:54 user nova-compute[73079]:       <nova:flavor name="m1.small">
Aug 17 15:11:54 user nova-compute[73079]:         <nova:memory>2048</nova:memory>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:disk>20</nova:disk>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:11:54 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:11:54 user nova-compute[73079]:       <nova:owner>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:user uuid="bcfb392dca9d4008b1ca9655cedaef6c">tempest-ServerActionsTestOtherA-1400100504-project-member</nova:user>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:project uuid="13613dce4b924a33b76cdfac1a23cb3c">tempest-ServerActionsTestOtherA-1400100504</nova:project>
Aug 17 15:11:54 user nova-compute[73079]:       </nova:owner>
Aug 17 15:11:54 user nova-compute[73079]:       <nova:ports>
Aug 17 15:11:54 user nova-compute[73079]:         <nova:port uuid="12be255e-46c2-464d-a90f-36885eb46551">
Aug 17 15:11:54 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 15:11:54 user nova-compute[73079]:         </nova:port>
Aug 17 15:11:54 user nova-compute[73079]:       </nova:ports>
Aug 17 15:11:54 user nova-compute[73079]:     </nova:instance>
Aug 17 15:11:54 user nova-compute[73079]:   </metadata>
Aug 17 15:11:54 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:11:54 user nova-compute[73079]:     <system>
Aug 17 15:11:54 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:11:54 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:11:54 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:11:54 user nova-compute[73079]:       <entry name="serial">045fac1e-d82a-4f51-8793-e047277572c4</entry>
Aug 17 15:11:54 user nova-compute[73079]:       <entry name="uuid">045fac1e-d82a-4f51-8793-e047277572c4</entry>
Aug 17 15:11:54 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:11:54 user nova-compute[73079]:     </system>
Aug 17 15:11:54 user nova-compute[73079]:   </sysinfo>
Aug 17 15:11:54 user nova-compute[73079]:   <os>
Aug 17 15:11:54 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:11:54 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:11:54 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:11:54 user nova-compute[73079]:   </os>
Aug 17 15:11:54 user nova-compute[73079]:   <features>
Aug 17 15:11:54 user nova-compute[73079]:     <acpi/>
Aug 17 15:11:54 user nova-compute[73079]:     <apic/>
Aug 17 15:11:54 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:11:54 user nova-compute[73079]:   </features>
Aug 17 15:11:54 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:11:54 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:11:54 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:11:54 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:11:54 user nova-compute[73079]:   </clock>
Aug 17 15:11:54 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:11:54 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:11:54 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:11:54 user nova-compute[73079]:   </cpu>
Aug 17 15:11:54 user nova-compute[73079]:   <devices>
Aug 17 15:11:54 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:11:54 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:11:54 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 15:11:54 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:11:54 user nova-compute[73079]:       <serial>dc19bfbd-40d0-4dcc-8e52-523944713606</serial>
Aug 17 15:11:54 user nova-compute[73079]:     </disk>
Aug 17 15:11:54 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:11:54 user nova-compute[73079]:       <mac address="fa:16:3e:57:9e:8b"/>
Aug 17 15:11:54 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:11:54 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:11:54 user nova-compute[73079]:       <target dev="tap12be255e-46"/>
Aug 17 15:11:54 user nova-compute[73079]:     </interface>
Aug 17 15:11:54 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:11:54 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/045fac1e-d82a-4f51-8793-e047277572c4/console.log" append="off"/>
Aug 17 15:11:54 user nova-compute[73079]:     </serial>
Aug 17 15:11:54 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:11:54 user nova-compute[73079]:     <video>
Aug 17 15:11:54 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:11:54 user nova-compute[73079]:     </video>
Aug 17 15:11:54 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:11:54 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:11:54 user nova-compute[73079]:     </rng>
Aug 17 15:11:54 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:11:54 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:11:54 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:11:54 user nova-compute[73079]:     </memballoon>
Aug 17 15:11:54 user nova-compute[73079]:   </devices>
Aug 17 15:11:54 user nova-compute[73079]: </domain>
Aug 17 15:11:54 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1087027143',display_name='tempest-ServerActionsTestOtherA-server-1087027143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1087027143',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:09:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-jdouwmzd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=045fac1e-d82a-4f51-8793-e047277572c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1358345301-network", "vif_mac": "fa:16:3e:57:9e:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG os_vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12be255e-46, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12be255e-46, col_values=(('external_ids', {'iface-id': '12be255e-46c2-464d-a90f-36885eb46551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:9e:8b', 'vm-uuid': '045fac1e-d82a-4f51-8793-e047277572c4'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:11:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:55 user nova-compute[73079]: INFO os_vif [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46')
Aug 17 15:11:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:11:55 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] No VIF found with MAC fa:16:3e:57:9e:8b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-22dfd524-0b39-4c81-81cc-f27dbc803f98 req-450157a6-4973-43c4-a6c4-3eff7e51e01b service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-22dfd524-0b39-4c81-81cc-f27dbc803f98 req-450157a6-4973-43c4-a6c4-3eff7e51e01b service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-22dfd524-0b39-4c81-81cc-f27dbc803f98 req-450157a6-4973-43c4-a6c4-3eff7e51e01b service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-22dfd524-0b39-4c81-81cc-f27dbc803f98 req-450157a6-4973-43c4-a6c4-3eff7e51e01b service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-22dfd524-0b39-4c81-81cc-f27dbc803f98 req-450157a6-4973-43c4-a6c4-3eff7e51e01b service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:11:56 user nova-compute[73079]: WARNING nova.compute.manager [req-22dfd524-0b39-4c81-81cc-f27dbc803f98 req-450157a6-4973-43c4-a6c4-3eff7e51e01b service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state active and task_state resize_finish.
Aug 17 15:11:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285118.5259645, 045fac1e-d82a-4f51-8793-e047277572c4 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:11:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] VM Resumed (Lifecycle Event)
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:11:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance running successfully.
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Failed to set time: agent not configured {{(pid=73079) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e303c77f-b54b-4747-b98e-0eeae17d073c tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] finish_migration finished successfully. {{(pid=73079) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:11:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285118.5270576, 045fac1e-d82a-4f51-8793-e047277572c4 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:11:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] VM Started (Lifecycle Event)
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:11:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-df428c50-a4b6-472a-8cb3-82c3892d0992 req-8e0cbe6d-995f-413d-b944-4036d0e4f9a6 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df428c50-a4b6-472a-8cb3-82c3892d0992 req-8e0cbe6d-995f-413d-b944-4036d0e4f9a6 service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df428c50-a4b6-472a-8cb3-82c3892d0992 req-8e0cbe6d-995f-413d-b944-4036d0e4f9a6 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df428c50-a4b6-472a-8cb3-82c3892d0992 req-8e0cbe6d-995f-413d-b944-4036d0e4f9a6 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:11:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-df428c50-a4b6-472a-8cb3-82c3892d0992 req-8e0cbe6d-995f-413d-b944-4036d0e4f9a6 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:11:58 user nova-compute[73079]: WARNING nova.compute.manager [req-df428c50-a4b6-472a-8cb3-82c3892d0992 req-8e0cbe6d-995f-413d-b944-4036d0e4f9a6 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state active and task_state resize_finish.
Aug 17 15:11:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:12:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:12:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:12:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:12:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:12:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:12:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:12:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:12:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:12:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:12:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:12:17 user nova-compute[73079]: INFO nova.compute.claims [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Claim successful on node user
Aug 17 15:12:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:12:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.policy [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7058f4f621ba4ce481afe66bd3d2f687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f624a4a5d694ca8915dcf60facde021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:12:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Creating image(s)
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "/opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "/opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.231s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk 1073741824" returned: 0 in 0.051s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Successfully created port: ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Cannot resize image /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lazy-loading 'migration_context' on Instance uuid 4e1914da-53d2-4009-9a3b-d9c7806845b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Ensure instance console log exists: /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Successfully updated port: ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "refresh_cache-4e1914da-53d2-4009-9a3b-d9c7806845b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquired lock "refresh_cache-4e1914da-53d2-4009-9a3b-d9c7806845b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-changed-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Refreshing instance network info cache due to event network-changed-ed0537bb-b1f2-423a-b1ff-052013bde989. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] Acquiring lock "refresh_cache-4e1914da-53d2-4009-9a3b-d9c7806845b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Updating instance_info_cache with network_info: [{"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Releasing lock "refresh_cache-4e1914da-53d2-4009-9a3b-d9c7806845b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Instance network_info: |[{"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] Acquired lock "refresh_cache-4e1914da-53d2-4009-9a3b-d9c7806845b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.network.neutron [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Refreshing network info cache for port ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:12:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Start _get_guest_xml network_info=[{"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:12:19 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:12:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1597601619',display_name='tempest-VolumesNegativeTest-instance-1597601619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1597601619',id=45,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f624a4a5d694ca8915dcf60facde021',ramdisk_id='',reservation_id='r-biegjyg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-379449584',owner_user_name='tempest-VolumesNegativeTest-379449584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:12:18Z,user_data=None,user_id='7058f4f621ba4ce481afe66bd3d2f687',uuid=4e1914da-53d2-4009-9a3b-d9c7806845b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Converting VIF {"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.objects.instance [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e1914da-53d2-4009-9a3b-d9c7806845b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:12:20 user nova-compute[73079]:   <uuid>4e1914da-53d2-4009-9a3b-d9c7806845b3</uuid>
Aug 17 15:12:20 user nova-compute[73079]:   <name>instance-0000002d</name>
Aug 17 15:12:20 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:12:20 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:12:20 user nova-compute[73079]:   <metadata>
Aug 17 15:12:20 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:12:20 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:12:20 user nova-compute[73079]:       <nova:name>tempest-VolumesNegativeTest-instance-1597601619</nova:name>
Aug 17 15:12:20 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:12:20</nova:creationTime>
Aug 17 15:12:20 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:12:20 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:12:20 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:12:20 user nova-compute[73079]:       <nova:owner>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:user uuid="7058f4f621ba4ce481afe66bd3d2f687">tempest-VolumesNegativeTest-379449584-project-member</nova:user>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:project uuid="1f624a4a5d694ca8915dcf60facde021">tempest-VolumesNegativeTest-379449584</nova:project>
Aug 17 15:12:20 user nova-compute[73079]:       </nova:owner>
Aug 17 15:12:20 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:12:20 user nova-compute[73079]:       <nova:ports>
Aug 17 15:12:20 user nova-compute[73079]:         <nova:port uuid="ed0537bb-b1f2-423a-b1ff-052013bde989">
Aug 17 15:12:20 user nova-compute[73079]:           <nova:ip type="fixed" address="192.168.233.102" ipVersion="4"/>
Aug 17 15:12:20 user nova-compute[73079]:         </nova:port>
Aug 17 15:12:20 user nova-compute[73079]:       </nova:ports>
Aug 17 15:12:20 user nova-compute[73079]:     </nova:instance>
Aug 17 15:12:20 user nova-compute[73079]:   </metadata>
Aug 17 15:12:20 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:12:20 user nova-compute[73079]:     <system>
Aug 17 15:12:20 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:12:20 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:12:20 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:12:20 user nova-compute[73079]:       <entry name="serial">4e1914da-53d2-4009-9a3b-d9c7806845b3</entry>
Aug 17 15:12:20 user nova-compute[73079]:       <entry name="uuid">4e1914da-53d2-4009-9a3b-d9c7806845b3</entry>
Aug 17 15:12:20 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:12:20 user nova-compute[73079]:     </system>
Aug 17 15:12:20 user nova-compute[73079]:   </sysinfo>
Aug 17 15:12:20 user nova-compute[73079]:   <os>
Aug 17 15:12:20 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:12:20 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:12:20 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:12:20 user nova-compute[73079]:   </os>
Aug 17 15:12:20 user nova-compute[73079]:   <features>
Aug 17 15:12:20 user nova-compute[73079]:     <acpi/>
Aug 17 15:12:20 user nova-compute[73079]:     <apic/>
Aug 17 15:12:20 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:12:20 user nova-compute[73079]:   </features>
Aug 17 15:12:20 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:12:20 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:12:20 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:12:20 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:12:20 user nova-compute[73079]:   </clock>
Aug 17 15:12:20 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:12:20 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:12:20 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:12:20 user nova-compute[73079]:   </cpu>
Aug 17 15:12:20 user nova-compute[73079]:   <devices>
Aug 17 15:12:20 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:12:20 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:12:20 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk"/>
Aug 17 15:12:20 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:12:20 user nova-compute[73079]:     </disk>
Aug 17 15:12:20 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:12:20 user nova-compute[73079]:       <mac address="fa:16:3e:67:5f:dd"/>
Aug 17 15:12:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:12:20 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:12:20 user nova-compute[73079]:       <target dev="taped0537bb-b1"/>
Aug 17 15:12:20 user nova-compute[73079]:     </interface>
Aug 17 15:12:20 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:12:20 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/console.log" append="off"/>
Aug 17 15:12:20 user nova-compute[73079]:     </serial>
Aug 17 15:12:20 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:12:20 user nova-compute[73079]:     <video>
Aug 17 15:12:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:12:20 user nova-compute[73079]:     </video>
Aug 17 15:12:20 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:12:20 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:12:20 user nova-compute[73079]:     </rng>
Aug 17 15:12:20 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:12:20 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:12:20 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:12:20 user nova-compute[73079]:     </memballoon>
Aug 17 15:12:20 user nova-compute[73079]:   </devices>
Aug 17 15:12:20 user nova-compute[73079]: </domain>
Aug 17 15:12:20 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1597601619',display_name='tempest-VolumesNegativeTest-instance-1597601619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1597601619',id=45,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f624a4a5d694ca8915dcf60facde021',ramdisk_id='',reservation_id='r-biegjyg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-379449584',owner_user_name='tempest-VolumesNegativeTest-379449584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:12:18Z,user_data=None,user_id='7058f4f621ba4ce481afe66bd3d2f687',uuid=4e1914da-53d2-4009-9a3b-d9c7806845b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Converting VIF {"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG os_vif [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped0537bb-b1, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped0537bb-b1, col_values=(('external_ids', {'iface-id': 'ed0537bb-b1f2-423a-b1ff-052013bde989', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:5f:dd', 'vm-uuid': '4e1914da-53d2-4009-9a3b-d9c7806845b3'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:20 user nova-compute[73079]: INFO os_vif [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1')
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] No VIF found with MAC fa:16:3e:67:5f:dd, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Updated VIF entry in instance network info cache for port ed0537bb-b1f2-423a-b1ff-052013bde989. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Updating instance_info_cache with network_info: [{"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:12:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b5c9436e-a488-472c-9603-587a8ebec596 req-4086ad82-f783-4c0b-a4f9-3e58fd9f598c service nova] Releasing lock "refresh_cache-4e1914da-53d2-4009-9a3b-d9c7806845b3" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1c8302-60f4-4954-87d0-d8b94431ff1a req-c8a10410-16a4-470e-9b16-7b42b161096f service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0a1c8302-60f4-4954-87d0-d8b94431ff1a req-c8a10410-16a4-470e-9b16-7b42b161096f service nova] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0a1c8302-60f4-4954-87d0-d8b94431ff1a req-c8a10410-16a4-470e-9b16-7b42b161096f service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0a1c8302-60f4-4954-87d0-d8b94431ff1a req-c8a10410-16a4-470e-9b16-7b42b161096f service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-0a1c8302-60f4-4954-87d0-d8b94431ff1a req-c8a10410-16a4-470e-9b16-7b42b161096f service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] No waiting events found dispatching network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:12:21 user nova-compute[73079]: WARNING nova.compute.manager [req-0a1c8302-60f4-4954-87d0-d8b94431ff1a req-c8a10410-16a4-470e-9b16-7b42b161096f service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received unexpected event network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 for instance with vm_state building and task_state spawning.
Aug 17 15:12:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285143.75846, 4e1914da-53d2-4009-9a3b-d9c7806845b3 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] VM Resumed (Lifecycle Event)
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Instance spawned successfully.
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285143.760208, 4e1914da-53d2-4009-9a3b-d9c7806845b3 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] VM Started (Lifecycle Event)
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-25c1975a-716a-4e73-98c2-224e939e276b req-6c35cd7e-517f-4942-8c40-1724fd5ffe0a service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-25c1975a-716a-4e73-98c2-224e939e276b req-6c35cd7e-517f-4942-8c40-1724fd5ffe0a service nova] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-25c1975a-716a-4e73-98c2-224e939e276b req-6c35cd7e-517f-4942-8c40-1724fd5ffe0a service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-25c1975a-716a-4e73-98c2-224e939e276b req-6c35cd7e-517f-4942-8c40-1724fd5ffe0a service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-25c1975a-716a-4e73-98c2-224e939e276b req-6c35cd7e-517f-4942-8c40-1724fd5ffe0a service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] No waiting events found dispatching network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:12:23 user nova-compute[73079]: WARNING nova.compute.manager [req-25c1975a-716a-4e73-98c2-224e939e276b req-6c35cd7e-517f-4942-8c40-1724fd5ffe0a service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received unexpected event network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 for instance with vm_state building and task_state spawning.
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 17 15:12:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:12:23 user nova-compute[73079]: INFO nova.compute.manager [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Took 6.46 seconds to build instance.
Aug 17 15:12:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3933f69e-ab93-49fd-b653-489ddb28f333 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.550s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:12:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:12:30 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:12:30 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8586MB free_disk=25.355594635009766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Applying migration context for instance 045fac1e-d82a-4f51-8793-e047277572c4 as it has an incoming, in-progress migration 4ea36590-e0cc-48bf-8d65-33cb44e63fc2. Migration status is finished {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 15:12:30 user nova-compute[73079]: INFO nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating resource usage from migration 4ea36590-e0cc-48bf-8d65-33cb44e63fc2
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Migration 4ea36590-e0cc-48bf-8d65-33cb44e63fc2 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 045fac1e-d82a-4f51-8793-e047277572c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 4e1914da-53d2-4009-9a3b-d9c7806845b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:12:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:12:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:12:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:12:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:12:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:12:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:12:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:12:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:12:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:12:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:12:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:13:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:13:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Going to confirm migration 2 {{(pid=73079) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG nova.network.neutron [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:13:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'info_cache' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG nova.network.neutron [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG nova.objects.instance [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'migration_context' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.203s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:13:24 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Deleted allocation for migration 4ea36590-e0cc-48bf-8d65-33cb44e63fc2
Aug 17 15:13:24 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-19ba4d80-e957-49a9-bf29-d1ba536c3dac tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.223s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:13:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:13:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:13:30 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:13:30 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=25.327159881591797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 045fac1e-d82a-4f51-8793-e047277572c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 4e1914da-53d2-4009-9a3b-d9c7806845b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:13:30 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:13:31 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:13:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [{"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-045fac1e-d82a-4f51-8793-e047277572c4" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:13:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:13:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:13:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:13:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:13:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:13:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:13:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:14:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:14:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:14:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:07 user nova-compute[73079]: INFO nova.compute.manager [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Terminating instance
Aug 17 15:14:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-d252b7c1-e31c-49f8-8fca-07a03160591e req-5e5b449d-6fe3-4317-ba21-0419e318ab5e service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-vif-unplugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d252b7c1-e31c-49f8-8fca-07a03160591e req-5e5b449d-6fe3-4317-ba21-0419e318ab5e service nova] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d252b7c1-e31c-49f8-8fca-07a03160591e req-5e5b449d-6fe3-4317-ba21-0419e318ab5e service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d252b7c1-e31c-49f8-8fca-07a03160591e req-5e5b449d-6fe3-4317-ba21-0419e318ab5e service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-d252b7c1-e31c-49f8-8fca-07a03160591e req-5e5b449d-6fe3-4317-ba21-0419e318ab5e service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] No waiting events found dispatching network-vif-unplugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-d252b7c1-e31c-49f8-8fca-07a03160591e req-5e5b449d-6fe3-4317-ba21-0419e318ab5e service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-vif-unplugged-ed0537bb-b1f2-423a-b1ff-052013bde989 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:08 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Instance destroyed successfully.
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lazy-loading 'resources' on Instance uuid 4e1914da-53d2-4009-9a3b-d9c7806845b3 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1597601619',display_name='tempest-VolumesNegativeTest-instance-1597601619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1597601619',id=45,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f624a4a5d694ca8915dcf60facde021',ramdisk_id='',reservation_id='r-biegjyg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-379449584',owner_user_name='tempest-VolumesNegativeTest-379449584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:12:24Z,user_data=None,user_id='7058f4f621ba4ce481afe66bd3d2f687',uuid=4e1914da-53d2-4009-9a3b-d9c7806845b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Converting VIF {"id": "ed0537bb-b1f2-423a-b1ff-052013bde989", "address": "fa:16:3e:67:5f:dd", "network": {"id": "698e12d5-8a63-425a-a7c4-be2e13b73dc8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "219cab4e912e408e9ca1efe05166c3ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0537bb-b1", "ovs_interfaceid": "ed0537bb-b1f2-423a-b1ff-052013bde989", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG os_vif [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped0537bb-b1, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:08 user nova-compute[73079]: INFO os_vif [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:5f:dd,bridge_name='br-int',has_traffic_filtering=True,id=ed0537bb-b1f2-423a-b1ff-052013bde989,network=Network(698e12d5-8a63-425a-a7c4-be2e13b73dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0537bb-b1')
Aug 17 15:14:08 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Deleting instance files /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3_del
Aug 17 15:14:08 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Deletion of /opt/stack/data/nova/instances/4e1914da-53d2-4009-9a3b-d9c7806845b3_del complete
Aug 17 15:14:08 user nova-compute[73079]: INFO nova.compute.manager [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 15:14:08 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:14:08 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:14:08 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Took 0.50 seconds to deallocate network for instance.
Aug 17 15:14:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:09 user nova-compute[73079]: DEBUG nova.compute.manager [req-2244afcb-1a6b-4a0e-a75a-42010201196b req-c975a203-370a-44ea-a476-deec4b247f9f service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-vif-deleted-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:14:09 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:14:09 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:14:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:09 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Deleted allocations for instance 4e1914da-53d2-4009-9a3b-d9c7806845b3
Aug 17 15:14:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b2fcd7b4-69f6-4867-9862-208867ed7d31 tempest-VolumesNegativeTest-379449584 tempest-VolumesNegativeTest-379449584-project-member] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.670s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-466109c5-9cdb-44c1-87dd-4f2d48e93e04 req-10cc066b-93e8-43e5-a941-8d8c3ee72a27 service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received event network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:14:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-466109c5-9cdb-44c1-87dd-4f2d48e93e04 req-10cc066b-93e8-43e5-a941-8d8c3ee72a27 service nova] Acquiring lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-466109c5-9cdb-44c1-87dd-4f2d48e93e04 req-10cc066b-93e8-43e5-a941-8d8c3ee72a27 service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-466109c5-9cdb-44c1-87dd-4f2d48e93e04 req-10cc066b-93e8-43e5-a941-8d8c3ee72a27 service nova] Lock "4e1914da-53d2-4009-9a3b-d9c7806845b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-466109c5-9cdb-44c1-87dd-4f2d48e93e04 req-10cc066b-93e8-43e5-a941-8d8c3ee72a27 service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] No waiting events found dispatching network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:14:10 user nova-compute[73079]: WARNING nova.compute.manager [req-466109c5-9cdb-44c1-87dd-4f2d48e93e04 req-10cc066b-93e8-43e5-a941-8d8c3ee72a27 service nova] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Received unexpected event network-vif-plugged-ed0537bb-b1f2-423a-b1ff-052013bde989 for instance with vm_state deleted and task_state None.
Aug 17 15:14:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:14:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:14:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:14:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:23 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692285248.3771977, 4e1914da-53d2-4009-9a3b-d9c7806845b3 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:14:23 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] VM Stopped (Lifecycle Event)
Aug 17 15:14:23 user nova-compute[73079]: DEBUG nova.compute.manager [None req-ed027c6f-bf73-48dd-bd32-59f18bd26a90 None None] [instance: 4e1914da-53d2-4009-9a3b-d9c7806845b3] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:14:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:26 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:14:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:30 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:14:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:14:32 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:14:32 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8721MB free_disk=25.346511840820312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 045fac1e-d82a-4f51-8793-e047277572c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:14:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:14:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:14:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:14:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:14:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:14:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:14:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:14:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:15:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:14 user nova-compute[73079]: INFO nova.compute.manager [None req-acc1ae77-2839-40ed-a448-20fd672ad6bf tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Get console output
Aug 17 15:15:14 user nova-compute[73079]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 15:15:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:27 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:15:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:15:28 user nova-compute[73079]: INFO nova.compute.claims [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Claim successful on node user
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:15:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.policy [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '392ac56ddb824b94bb1c7743f7241313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206af61bece947499bacc93c93f73da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:15:28 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Creating image(s)
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:28 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Successfully created port: 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.part --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG nova.virt.images [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] a9afe607-5373-4efb-ad72-93e68cae582c was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.part /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.part /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.converted" returned: 0 in 0.397s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:29 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.248s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Successfully updated port: 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.compute.manager [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing instance network info cache due to event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7,backing_fmt=raw /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7,backing_fmt=raw /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk 1073741824" returned: 0 in 0.053s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.neutron [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance network_info: |[{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Cannot resize image /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'migration_context' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Ensure instance console log exists: /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Start _get_guest_xml network_info=[{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T15:15:25Z,direct_url=<?>,disk_format='qcow2',id=a9afe607-5373-4efb-ad72-93e68cae582c,min_disk=0,min_ram=0,name='tempest-scenario-img--2045835813',owner='206af61bece947499bacc93c93f73da7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T15:15:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'a9afe607-5373-4efb-ad72-93e68cae582c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:15:30 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:15:30 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T15:15:25Z,direct_url=<?>,disk_format='qcow2',id=a9afe607-5373-4efb-ad72-93e68cae582c,min_disk=0,min_ram=0,name='tempest-scenario-img--2045835813',owner='206af61bece947499bacc93c93f73da7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T15:15:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-496765803',display_name='tempest-TestMinimumBasicScenario-server-496765803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-496765803',id=46,image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkpY/JSvOaWDg47/sSzYQVO787OYmYpZ0YxmWer5h5TougqaRRjkdQ9aqrz4ErbJRTQGyGDpHqlbVEGRZmr/yGF1ubszHY4LcRCvnHqBAVGAf5DEvIp0BTvKuC02+t6w==',key_name='tempest-TestMinimumBasicScenario-160788929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-za2dmz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:15:29Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=3b546f82-ca73-4385-afc8-93ddad1199fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:15:30 user nova-compute[73079]: DEBUG nova.objects.instance [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:15:31 user nova-compute[73079]:   <uuid>3b546f82-ca73-4385-afc8-93ddad1199fd</uuid>
Aug 17 15:15:31 user nova-compute[73079]:   <name>instance-0000002e</name>
Aug 17 15:15:31 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:15:31 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:15:31 user nova-compute[73079]:   <metadata>
Aug 17 15:15:31 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:15:31 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:15:31 user nova-compute[73079]:       <nova:name>tempest-TestMinimumBasicScenario-server-496765803</nova:name>
Aug 17 15:15:31 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:15:30</nova:creationTime>
Aug 17 15:15:31 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:15:31 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:15:31 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:15:31 user nova-compute[73079]:       <nova:owner>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:user uuid="392ac56ddb824b94bb1c7743f7241313">tempest-TestMinimumBasicScenario-104665342-project-member</nova:user>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:project uuid="206af61bece947499bacc93c93f73da7">tempest-TestMinimumBasicScenario-104665342</nova:project>
Aug 17 15:15:31 user nova-compute[73079]:       </nova:owner>
Aug 17 15:15:31 user nova-compute[73079]:       <nova:root type="image" uuid="a9afe607-5373-4efb-ad72-93e68cae582c"/>
Aug 17 15:15:31 user nova-compute[73079]:       <nova:ports>
Aug 17 15:15:31 user nova-compute[73079]:         <nova:port uuid="9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6">
Aug 17 15:15:31 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:15:31 user nova-compute[73079]:         </nova:port>
Aug 17 15:15:31 user nova-compute[73079]:       </nova:ports>
Aug 17 15:15:31 user nova-compute[73079]:     </nova:instance>
Aug 17 15:15:31 user nova-compute[73079]:   </metadata>
Aug 17 15:15:31 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:15:31 user nova-compute[73079]:     <system>
Aug 17 15:15:31 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:15:31 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:15:31 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:15:31 user nova-compute[73079]:       <entry name="serial">3b546f82-ca73-4385-afc8-93ddad1199fd</entry>
Aug 17 15:15:31 user nova-compute[73079]:       <entry name="uuid">3b546f82-ca73-4385-afc8-93ddad1199fd</entry>
Aug 17 15:15:31 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:15:31 user nova-compute[73079]:     </system>
Aug 17 15:15:31 user nova-compute[73079]:   </sysinfo>
Aug 17 15:15:31 user nova-compute[73079]:   <os>
Aug 17 15:15:31 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:15:31 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:15:31 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:15:31 user nova-compute[73079]:   </os>
Aug 17 15:15:31 user nova-compute[73079]:   <features>
Aug 17 15:15:31 user nova-compute[73079]:     <acpi/>
Aug 17 15:15:31 user nova-compute[73079]:     <apic/>
Aug 17 15:15:31 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:15:31 user nova-compute[73079]:   </features>
Aug 17 15:15:31 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:15:31 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:15:31 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:15:31 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:15:31 user nova-compute[73079]:   </clock>
Aug 17 15:15:31 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:15:31 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:15:31 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:15:31 user nova-compute[73079]:   </cpu>
Aug 17 15:15:31 user nova-compute[73079]:   <devices>
Aug 17 15:15:31 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:15:31 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:15:31 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk"/>
Aug 17 15:15:31 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:15:31 user nova-compute[73079]:     </disk>
Aug 17 15:15:31 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:15:31 user nova-compute[73079]:       <mac address="fa:16:3e:1c:ba:55"/>
Aug 17 15:15:31 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:15:31 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:15:31 user nova-compute[73079]:       <target dev="tap9c848fbc-da"/>
Aug 17 15:15:31 user nova-compute[73079]:     </interface>
Aug 17 15:15:31 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:15:31 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/console.log" append="off"/>
Aug 17 15:15:31 user nova-compute[73079]:     </serial>
Aug 17 15:15:31 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:15:31 user nova-compute[73079]:     <video>
Aug 17 15:15:31 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:15:31 user nova-compute[73079]:     </video>
Aug 17 15:15:31 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:15:31 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:15:31 user nova-compute[73079]:     </rng>
Aug 17 15:15:31 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:15:31 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:15:31 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:15:31 user nova-compute[73079]:     </memballoon>
Aug 17 15:15:31 user nova-compute[73079]:   </devices>
Aug 17 15:15:31 user nova-compute[73079]: </domain>
Aug 17 15:15:31 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-496765803',display_name='tempest-TestMinimumBasicScenario-server-496765803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-496765803',id=46,image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkpY/JSvOaWDg47/sSzYQVO787OYmYpZ0YxmWer5h5TougqaRRjkdQ9aqrz4ErbJRTQGyGDpHqlbVEGRZmr/yGF1ubszHY4LcRCvnHqBAVGAf5DEvIp0BTvKuC02+t6w==',key_name='tempest-TestMinimumBasicScenario-160788929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-za2dmz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:15:29Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=3b546f82-ca73-4385-afc8-93ddad1199fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG os_vif [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c848fbc-da, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c848fbc-da, col_values=(('external_ids', {'iface-id': '9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:ba:55', 'vm-uuid': '3b546f82-ca73-4385-afc8-93ddad1199fd'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:31 user nova-compute[73079]: INFO os_vif [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da')
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No VIF found with MAC fa:16:3e:1c:ba:55, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.network.neutron [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated VIF entry in instance network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG nova.network.neutron [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:15:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3ae1db21-f603-4071-9037-ad57d5bb0539 req-f94d31ce-c8e2-4c41-b5cd-2e698d705dc2 service nova] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Skipping network cache update for instance because it is Building. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-225894b4-158f-44d2-b5a5-35eb27a06949 req-173e02e3-706c-44d6-9240-d1fe8ccaa019 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-225894b4-158f-44d2-b5a5-35eb27a06949 req-173e02e3-706c-44d6-9240-d1fe8ccaa019 service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-225894b4-158f-44d2-b5a5-35eb27a06949 req-173e02e3-706c-44d6-9240-d1fe8ccaa019 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-225894b4-158f-44d2-b5a5-35eb27a06949 req-173e02e3-706c-44d6-9240-d1fe8ccaa019 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-225894b4-158f-44d2-b5a5-35eb27a06949 req-173e02e3-706c-44d6-9240-d1fe8ccaa019 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:15:32 user nova-compute[73079]: WARNING nova.compute.manager [req-225894b4-158f-44d2-b5a5-35eb27a06949 req-173e02e3-706c-44d6-9240-d1fe8ccaa019 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state building and task_state spawning.
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [{"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-e7d185bd-dcc1-4ae4-91a6-b5684bcba937" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285334.6641977, 3b546f82-ca73-4385-afc8-93ddad1199fd => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:15:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] VM Resumed (Lifecycle Event)
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:15:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance spawned successfully.
Aug 17 15:15:34 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:15:34 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.282920837402344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:15:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285334.666147, 3b546f82-ca73-4385-afc8-93ddad1199fd => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:15:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] VM Started (Lifecycle Event)
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 045fac1e-d82a-4f51-8793-e047277572c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:15:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-aa531b27-c7f9-472e-af32-9b0c79b87c2f req-eb355c84-3e61-4885-8905-5394e572fe1f service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-aa531b27-c7f9-472e-af32-9b0c79b87c2f req-eb355c84-3e61-4885-8905-5394e572fe1f service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-aa531b27-c7f9-472e-af32-9b0c79b87c2f req-eb355c84-3e61-4885-8905-5394e572fe1f service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-aa531b27-c7f9-472e-af32-9b0c79b87c2f req-eb355c84-3e61-4885-8905-5394e572fe1f service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-aa531b27-c7f9-472e-af32-9b0c79b87c2f req-eb355c84-3e61-4885-8905-5394e572fe1f service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:15:34 user nova-compute[73079]: WARNING nova.compute.manager [req-aa531b27-c7f9-472e-af32-9b0c79b87c2f req-eb355c84-3e61-4885-8905-5394e572fe1f service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state building and task_state spawning.
Aug 17 15:15:34 user nova-compute[73079]: INFO nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 17 15:15:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:15:35 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:15:35 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:15:35 user nova-compute[73079]: INFO nova.compute.manager [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Took 6.79 seconds to build instance.
Aug 17 15:15:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:15:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-4adc6c4c-0bc9-44a9-9ecb-11565466a134 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Verify base images {{(pid=73079) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Image id a9afe607-5373-4efb-ad72-93e68cae582c yields fingerprint 9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 {{(pid=73079) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] image a9afe607-5373-4efb-ad72-93e68cae582c at (/opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7): checking
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] image a9afe607-5373-4efb-ad72-93e68cae582c at (/opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7): image is in use {{(pid=73079) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73079) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Image id f1520146-7ad6-41ad-91e3-e68a652af0d4 yields fingerprint 408e1c63fd971bb55b6d7969590ee4f79c1d6d98 {{(pid=73079) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] image f1520146-7ad6-41ad-91e3-e68a652af0d4 at (/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98): checking
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] image f1520146-7ad6-41ad-91e3-e68a652af0d4 at (/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98): image is in use {{(pid=73079) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] e7d185bd-dcc1-4ae4-91a6-b5684bcba937 is a valid instance name {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] e7d185bd-dcc1-4ae4-91a6-b5684bcba937 has a disk file {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 is backed by 408e1c63fd971bb55b6d7969590ee4f79c1d6d98 {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] 3b546f82-ca73-4385-afc8-93ddad1199fd is a valid instance name {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] 3b546f82-ca73-4385-afc8-93ddad1199fd has a disk file {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd is backed by 9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] 045fac1e-d82a-4f51-8793-e047277572c4 is a valid instance name {{(pid=73079) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 15:15:53 user nova-compute[73079]: WARNING nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307
Aug 17 15:15:53 user nova-compute[73079]: WARNING nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05
Aug 17 15:15:53 user nova-compute[73079]: WARNING nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1
Aug 17 15:15:53 user nova-compute[73079]: WARNING nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32
Aug 17 15:15:53 user nova-compute[73079]: WARNING nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394
Aug 17 15:15:53 user nova-compute[73079]: WARNING nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Active base files: /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Removable base files: /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307 /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05 /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1 /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32 /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394 /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b12f72ddd6f8947a9377dd1d174208a0a4dc307
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8d6b94967dedc125156cdc8ba10336113c7db05
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0dae4fe03faee2d6180689be5abd59145d8508b1
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/be1d8c346a00b8e54f88058e59a3b98fc5e5be32
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/592cf0a0e0bcc24ca691db4504ef813ec37e9394
Aug 17 15:15:53 user nova-compute[73079]: INFO nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7fc735c9b9956c914be3b1b6685757f4698929c8
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Verification complete {{(pid=73079) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Verify swap images {{(pid=73079) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 15:15:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.imagecache [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Verify ephemeral images {{(pid=73079) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 15:15:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:15:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:15 user nova-compute[73079]: INFO nova.compute.manager [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Terminating instance
Aug 17 15:16:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-0583fb2a-2a63-4880-9b3b-52716b91dd13 req-a6deef11-2629-48bd-874e-0c05fe88cc77 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-unplugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0583fb2a-2a63-4880-9b3b-52716b91dd13 req-a6deef11-2629-48bd-874e-0c05fe88cc77 service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0583fb2a-2a63-4880-9b3b-52716b91dd13 req-a6deef11-2629-48bd-874e-0c05fe88cc77 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0583fb2a-2a63-4880-9b3b-52716b91dd13 req-a6deef11-2629-48bd-874e-0c05fe88cc77 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-0583fb2a-2a63-4880-9b3b-52716b91dd13 req-a6deef11-2629-48bd-874e-0c05fe88cc77 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-unplugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:16:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-0583fb2a-2a63-4880-9b3b-52716b91dd13 req-a6deef11-2629-48bd-874e-0c05fe88cc77 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-unplugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Instance destroyed successfully.
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'resources' on Instance uuid 045fac1e-d82a-4f51-8793-e047277572c4 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1087027143',display_name='tempest-ServerActionsTestOtherA-server-1087027143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1087027143',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:11:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-jdouwmzd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=045fac1e-d82a-4f51-8793-e047277572c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "12be255e-46c2-464d-a90f-36885eb46551", "address": "fa:16:3e:57:9e:8b", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12be255e-46", "ovs_interfaceid": "12be255e-46c2-464d-a90f-36885eb46551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_vif [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12be255e-46, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:16:16 user nova-compute[73079]: INFO os_vif [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=12be255e-46c2-464d-a90f-36885eb46551,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12be255e-46')
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pTBGMmjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:16:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06b5eb-d040-4339-a745-b97cb3ac51d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c48084-d221-48bf-920a-7553815a7acf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:16:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 (non-flash)
Aug 17 15:16:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f62b5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ec04bc-4d0a-41fa-a0b7-d6c729d52aba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a1f5f6-39ff-4456-ae2d-709dbba9fb1f]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd208e9-4ff2-4434-9b0d-73e208f5d8e1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f5b910-51a5-47f9-b04d-8d6f77707104]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68137c3-6fd4-44f7-ac9c-d4a86eebfb79]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[60327244-a40b-43ba-8b52-940ac212f744]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260]
Aug 17 15:16:16 user nova-compute[73079]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606, portal: 172.16.0.220,3260] successful.
Aug 17 15:16:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc19bfbd-40d0-4dcc-8e52-523944713606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e00659e-5044-47e7-93cd-c7488a9337b1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] <== disconnect_volume: return (267ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:16:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Deleting instance files /opt/stack/data/nova/instances/045fac1e-d82a-4f51-8793-e047277572c4_del
Aug 17 15:16:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Deletion of /opt/stack/data/nova/instances/045fac1e-d82a-4f51-8793-e047277572c4_del complete
Aug 17 15:16:16 user nova-compute[73079]: INFO nova.compute.manager [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 15:16:16 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:16:16 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:16:17 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Took 1.03 seconds to deallocate network for instance.
Aug 17 15:16:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-bf2459c6-d6de-45da-b0ff-93f2579a03b2 req-507ab265-54ab-4917-912c-db7dfa50b8f8 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-deleted-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-1499b287-dea7-420b-b721-8e2234f6e8d0 req-b62bdc82-097f-4daf-951a-84b6de0bb1b8 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1499b287-dea7-420b-b721-8e2234f6e8d0 req-b62bdc82-097f-4daf-951a-84b6de0bb1b8 service nova] Acquiring lock "045fac1e-d82a-4f51-8793-e047277572c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1499b287-dea7-420b-b721-8e2234f6e8d0 req-b62bdc82-097f-4daf-951a-84b6de0bb1b8 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1499b287-dea7-420b-b721-8e2234f6e8d0 req-b62bdc82-097f-4daf-951a-84b6de0bb1b8 service nova] Lock "045fac1e-d82a-4f51-8793-e047277572c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-1499b287-dea7-420b-b721-8e2234f6e8d0 req-b62bdc82-097f-4daf-951a-84b6de0bb1b8 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] No waiting events found dispatching network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:16:17 user nova-compute[73079]: WARNING nova.compute.manager [req-1499b287-dea7-420b-b721-8e2234f6e8d0 req-b62bdc82-097f-4daf-951a-84b6de0bb1b8 service nova] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Received unexpected event network-vif-plugged-12be255e-46c2-464d-a90f-36885eb46551 for instance with vm_state active and task_state deleting.
Aug 17 15:16:18 user nova-compute[73079]: INFO nova.compute.manager [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Took 0.83 seconds to detach 1 volumes for instance.
Aug 17 15:16:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Deleting volume: dc19bfbd-40d0-4dcc-8e52-523944713606 {{(pid=73079) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 15:16:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:18 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:16:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:16:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:18 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Deleted allocations for instance 045fac1e-d82a-4f51-8793-e047277572c4
Aug 17 15:16:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e43c28cc-7927-4643-afb0-9edca0ba8dc2 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "045fac1e-d82a-4f51-8793-e047277572c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.562s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:16:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:31 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692285376.122924, 045fac1e-d82a-4f51-8793-e047277572c4 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:16:31 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] VM Stopped (Lifecycle Event)
Aug 17 15:16:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bda2d73e-39e1-4efc-8caa-4cfad59c2cb8 None None] [instance: 045fac1e-d82a-4f51-8793-e047277572c4] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:16:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:16:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:16:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:16:32 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:16:34 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:16:34 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=25.25396728515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:16:34 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:16:35 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:16:35 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:16:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:16:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:16:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:16:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:16:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:16:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:16:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:16:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:16:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:17:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:17:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:17:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:17:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:17:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:12 user nova-compute[73079]: INFO nova.compute.manager [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Terminating instance
Aug 17 15:17:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-71a3abbb-dfcb-4709-aae9-364cf96c2180 req-d604dbe3-40b3-4ec9-910e-3ca46258d28e service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-vif-unplugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-71a3abbb-dfcb-4709-aae9-364cf96c2180 req-d604dbe3-40b3-4ec9-910e-3ca46258d28e service nova] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-71a3abbb-dfcb-4709-aae9-364cf96c2180 req-d604dbe3-40b3-4ec9-910e-3ca46258d28e service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-71a3abbb-dfcb-4709-aae9-364cf96c2180 req-d604dbe3-40b3-4ec9-910e-3ca46258d28e service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-71a3abbb-dfcb-4709-aae9-364cf96c2180 req-d604dbe3-40b3-4ec9-910e-3ca46258d28e service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] No waiting events found dispatching network-vif-unplugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:17:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-71a3abbb-dfcb-4709-aae9-364cf96c2180 req-d604dbe3-40b3-4ec9-910e-3ca46258d28e service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-vif-unplugged-bae76952-ee78-41c5-8587-39aa52f950f4 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:17:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Instance destroyed successfully.
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lazy-loading 'resources' on Instance uuid e7d185bd-dcc1-4ae4-91a6-b5684bcba937 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T14:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-148204159',display_name='tempest-ServerActionsTestOtherA-server-148204159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-148204159',id=32,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwEVCcK5ZUIHhVfjfTviwj0BqPJ9BQjUKzTRM+4YlSp6hGuNizMjovdBVfwP7W+bPfLpSJcTa3aWQxyGuYxCGWEL0RCJOhQkXto8PbnIIdoH51jK4zzFrZ4kJJq703g1w==',key_name='tempest-keypair-786807118',keypairs=<?>,launch_index=0,launched_at=2023-08-17T14:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13613dce4b924a33b76cdfac1a23cb3c',ramdisk_id='',reservation_id='r-705d5y5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1400100504',owner_user_name='tempest-ServerActionsTestOtherA-1400100504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T14:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcfb392dca9d4008b1ca9655cedaef6c',uuid=e7d185bd-dcc1-4ae4-91a6-b5684bcba937,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converting VIF {"id": "bae76952-ee78-41c5-8587-39aa52f950f4", "address": "fa:16:3e:0f:e7:98", "network": {"id": "9066519f-877b-4032-95b3-7b71adeb4a99", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1358345301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13613dce4b924a33b76cdfac1a23cb3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae76952-ee", "ovs_interfaceid": "bae76952-ee78-41c5-8587-39aa52f950f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG os_vif [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbae76952-ee, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:13 user nova-compute[73079]: INFO os_vif [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:e7:98,bridge_name='br-int',has_traffic_filtering=True,id=bae76952-ee78-41c5-8587-39aa52f950f4,network=Network(9066519f-877b-4032-95b3-7b71adeb4a99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae76952-ee')
Aug 17 15:17:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Deleting instance files /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937_del
Aug 17 15:17:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Deletion of /opt/stack/data/nova/instances/e7d185bd-dcc1-4ae4-91a6-b5684bcba937_del complete
Aug 17 15:17:13 user nova-compute[73079]: INFO nova.compute.manager [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 15:17:13 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:17:13 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Took 0.51 seconds to deallocate network for instance.
Aug 17 15:17:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:14 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Deleted allocations for instance e7d185bd-dcc1-4ae4-91a6-b5684bcba937
Aug 17 15:17:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8834fdaf-d3ee-4fcf-bf0a-a35dbf977b75 tempest-ServerActionsTestOtherA-1400100504 tempest-ServerActionsTestOtherA-1400100504-project-member] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.846s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] Acquiring lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] Lock "e7d185bd-dcc1-4ae4-91a6-b5684bcba937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] No waiting events found dispatching network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:17:14 user nova-compute[73079]: WARNING nova.compute.manager [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received unexpected event network-vif-plugged-bae76952-ee78-41c5-8587-39aa52f950f4 for instance with vm_state deleted and task_state None.
Aug 17 15:17:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-59a1c03c-aa3d-47e1-8034-11f3250360b7 req-85b88942-9495-46c8-9b56-04767781cdd6 service nova] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Received event network-vif-deleted-bae76952-ee78-41c5-8587-39aa52f950f4 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'flavor' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:23 user nova-compute[73079]: INFO nova.compute.manager [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Attaching volume a75aef53-21ce-49b3-a4b3-34daaedbdd02 to /dev/vdb
Aug 17 15:17:23 user nova-compute[73079]: DEBUG os_brick.utils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86b5b3-6a91-4a4c-abaf-f47518faf900]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a36cd-2489-42b5-a035-489232220f98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eb4540-06c5-4eb7-a223-32a27e0ed637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e127db-3379-4b86-b52d-8812648d8e68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:17:23 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:17:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[72949494-6c69-4248-9131-a73c5f8cdf81]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG os_brick.utils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:17:23 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating existing volume attachment record: fb90b774-fd32-4d74-bd8b-407d5e753996 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:17:28 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692285433.2351432, e7d185bd-dcc1-4ae4-91a6-b5684bcba937 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:17:28 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] VM Stopped (Lifecycle Event)
Aug 17 15:17:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-26d95c82-f5e6-4f1d-b34c-ec2a1e8e3a30 None None] [instance: e7d185bd-dcc1-4ae4-91a6-b5684bcba937] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:17:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:17:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:17:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:17:33 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb01a362-23a5-40c0-ba94-4ec3975b46da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:17:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d3902-f541-4fee-b1fc-6349fc9ed46a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02] added
Aug 17 15:17:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de66fe-9086-4412-bbaf-5a989082c09d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc52d7-f32c-4d1a-9c91-6bfd49661371]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBvEoTwQ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBvEoTwQ" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[be05e672-ebaf-4c92-981c-a4621860f76a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBvEoTwQ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b798d-6cb8-45b9-87a8-e976aa7cabf0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad046786-69aa-48b5-8013-e41f217f3c53]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:17:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:17:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:17:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:17:33 user nova-compute[73079]: 
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee488f-771d-40c1-8bae-b76c5b1eaa74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]
Aug 17 15:17:33 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.
Aug 17 15:17:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d018ef52-f5dc-4c6c-ab34-c2d19ecbb007]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d9ac36-0545-4705-94b2-1228968e357d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:17:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:17:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[deabd8ba-855d-4ec6-8a53-73451c4ad6e0]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:17:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26366623135306633', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366623135306633', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'flavor' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:17:34 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:17:34 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:17:34 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:17:34 user nova-compute[73079]:   <serial>a75aef53-21ce-49b3-a4b3-34daaedbdd02</serial>
Aug 17 15:17:34 user nova-compute[73079]: </disk>
Aug 17 15:17:34 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:17:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:35 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:17:35 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.280765533447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No VIF found with MAC fa:16:3e:1c:ba:55, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9aea1386-604b-4f10-9ff9-1f61b93384c5 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.287s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:17:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:39 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:17:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:17:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG nova.compute.manager [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing instance network info cache due to event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated VIF entry in instance network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:17:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-285e34df-0bce-48bd-956b-10e3764be53f req-f0a6e0bc-b68b-4bd6-8231-cafc10144840 service nova] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:17:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing instance network info cache due to event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:17:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:17:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:17:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:17:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated VIF entry in instance network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:17:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:17:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-10efa718-5383-467a-814d-1427f5cb077a req-6bdf9c1f-0660-459f-aef7-361cbed886dc service nova] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:17:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:55 user nova-compute[73079]: INFO nova.compute.manager [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Rebooting instance
Aug 17 15:17:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:17:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:17:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-bfa232cf-4076-4993-8949-e39eb10abb1d req-fc8e7952-328d-4958-83e1-e14a7c61805e service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-unplugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bfa232cf-4076-4993-8949-e39eb10abb1d req-fc8e7952-328d-4958-83e1-e14a7c61805e service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bfa232cf-4076-4993-8949-e39eb10abb1d req-fc8e7952-328d-4958-83e1-e14a7c61805e service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bfa232cf-4076-4993-8949-e39eb10abb1d req-fc8e7952-328d-4958-83e1-e14a7c61805e service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-bfa232cf-4076-4993-8949-e39eb10abb1d req-fc8e7952-328d-4958-83e1-e14a7c61805e service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-unplugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:17:56 user nova-compute[73079]: WARNING nova.compute.manager [req-bfa232cf-4076-4993-8949-e39eb10abb1d req-fc8e7952-328d-4958-83e1-e14a7c61805e service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-unplugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 15:17:57 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance destroyed successfully.
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'resources' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-496765803',display_name='tempest-TestMinimumBasicScenario-server-496765803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-496765803',id=46,image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkpY/JSvOaWDg47/sSzYQVO787OYmYpZ0YxmWer5h5TougqaRRjkdQ9aqrz4ErbJRTQGyGDpHqlbVEGRZmr/yGF1ubszHY4LcRCvnHqBAVGAf5DEvIp0BTvKuC02+t6w==',key_name='tempest-TestMinimumBasicScenario-160788929',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-za2dmz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:17:56Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=3b546f82-ca73-4385-afc8-93ddad1199fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c848fbc-da, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:57 user nova-compute[73079]: INFO os_vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da')
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:17:57 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7eb33f-4640-4501-b2d6-deec5d572f0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c2885c-14d1-4992-aa92-3c52a4e0f1d7]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e83dca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5066afff-60b1-4ee4-ac87-25fb4370534a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c442a7-776e-429c-9289-11b3313603f8]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d48ac-2b62-4599-b780-ecde33b74e66]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089fc55-d88b-4e6f-a324-38aafc3472bd]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e0884-ecc6-44a8-b397-221329d3ee11]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f0ba35-5931-4498-be89-14d4941e7b40]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]
Aug 17 15:17:57 user nova-compute[73079]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae91eb1-0b48-4e5b-8e0f-a075b396dcde]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== disconnect_volume: return (269ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Start _get_guest_xml network_info=[{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9afe607-5373-4efb-ad72-93e68cae582c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'a9afe607-5373-4efb-ad72-93e68cae582c'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'attachment_id': 'fb90b774-fd32-4d74-bd8b-407d5e753996', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3b546f82-ca73-4385-afc8-93ddad1199fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'a75aef53-21ce-49b3-a4b3-34daaedbdd02', 'serial': 'a75aef53-21ce-49b3-a4b3-34daaedbdd02'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:17:57 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:17:57 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a9afe607-5373-4efb-ad72-93e68cae582c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:17:57 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:17:57 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:17:57 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f5006d-c689-4200-8151-099655a616f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:17:57 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce1e550-694a-49b3-8967-f0fdce38fa05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02] added
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca823542-d1da-4b5d-b86c-b7f05d5eff40]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b42467d-a857-4ddb-8450-b7e4a7cb6f63]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBvEoTwQ {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBvEoTwQ" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9d39f-581c-4154-9e9e-9ec220f4f9f5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBvEoTwQ'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8398964-d275-4351-977d-fec49ffda475]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcacd94-6504-4bb1-b1c5-3d1ba20303f7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:17:57 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:17:57 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:17:57 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:17:57 user nova-compute[73079]: 
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d61bf02-c3b0-40d7-be65-7ddcdb564abc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]
Aug 17 15:17:57 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0323c2f6-dedb-4ac1-96c3-c59b8daee932]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[15894431-310a-4657-942f-1e151097793b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:17:57 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e62c1-207f-44d1-b7f6-345bc88e0ec4]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:17:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-d111c1c0-9f88-4e7f-915c-a682480ca8b6 req-44b238f8-cd90-437a-becf-aa35a5725892 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d111c1c0-9f88-4e7f-915c-a682480ca8b6 req-44b238f8-cd90-437a-becf-aa35a5725892 service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d111c1c0-9f88-4e7f-915c-a682480ca8b6 req-44b238f8-cd90-437a-becf-aa35a5725892 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d111c1c0-9f88-4e7f-915c-a682480ca8b6 req-44b238f8-cd90-437a-becf-aa35a5725892 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-d111c1c0-9f88-4e7f-915c-a682480ca8b6 req-44b238f8-cd90-437a-becf-aa35a5725892 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:17:58 user nova-compute[73079]: WARNING nova.compute.manager [req-d111c1c0-9f88-4e7f-915c-a682480ca8b6 req-44b238f8-cd90-437a-becf-aa35a5725892 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 15:17:58 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26366623135306633', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366623135306633', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-496765803',display_name='tempest-TestMinimumBasicScenario-server-496765803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-496765803',id=46,image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkpY/JSvOaWDg47/sSzYQVO787OYmYpZ0YxmWer5h5TougqaRRjkdQ9aqrz4ErbJRTQGyGDpHqlbVEGRZmr/yGF1ubszHY4LcRCvnHqBAVGAf5DEvIp0BTvKuC02+t6w==',key_name='tempest-TestMinimumBasicScenario-160788929',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-za2dmz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:17:56Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=3b546f82-ca73-4385-afc8-93ddad1199fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:17:58 user nova-compute[73079]:   <uuid>3b546f82-ca73-4385-afc8-93ddad1199fd</uuid>
Aug 17 15:17:58 user nova-compute[73079]:   <name>instance-0000002e</name>
Aug 17 15:17:58 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:17:58 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:17:58 user nova-compute[73079]:   <metadata>
Aug 17 15:17:58 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:17:58 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:17:58 user nova-compute[73079]:       <nova:name>tempest-TestMinimumBasicScenario-server-496765803</nova:name>
Aug 17 15:17:58 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:17:57</nova:creationTime>
Aug 17 15:17:58 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:17:58 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:17:58 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:17:58 user nova-compute[73079]:       <nova:owner>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:user uuid="392ac56ddb824b94bb1c7743f7241313">tempest-TestMinimumBasicScenario-104665342-project-member</nova:user>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:project uuid="206af61bece947499bacc93c93f73da7">tempest-TestMinimumBasicScenario-104665342</nova:project>
Aug 17 15:17:58 user nova-compute[73079]:       </nova:owner>
Aug 17 15:17:58 user nova-compute[73079]:       <nova:root type="image" uuid="a9afe607-5373-4efb-ad72-93e68cae582c"/>
Aug 17 15:17:58 user nova-compute[73079]:       <nova:ports>
Aug 17 15:17:58 user nova-compute[73079]:         <nova:port uuid="9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6">
Aug 17 15:17:58 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:17:58 user nova-compute[73079]:         </nova:port>
Aug 17 15:17:58 user nova-compute[73079]:       </nova:ports>
Aug 17 15:17:58 user nova-compute[73079]:     </nova:instance>
Aug 17 15:17:58 user nova-compute[73079]:   </metadata>
Aug 17 15:17:58 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:17:58 user nova-compute[73079]:     <system>
Aug 17 15:17:58 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:17:58 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:17:58 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:17:58 user nova-compute[73079]:       <entry name="serial">3b546f82-ca73-4385-afc8-93ddad1199fd</entry>
Aug 17 15:17:58 user nova-compute[73079]:       <entry name="uuid">3b546f82-ca73-4385-afc8-93ddad1199fd</entry>
Aug 17 15:17:58 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:17:58 user nova-compute[73079]:     </system>
Aug 17 15:17:58 user nova-compute[73079]:   </sysinfo>
Aug 17 15:17:58 user nova-compute[73079]:   <os>
Aug 17 15:17:58 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:17:58 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:17:58 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:17:58 user nova-compute[73079]:   </os>
Aug 17 15:17:58 user nova-compute[73079]:   <features>
Aug 17 15:17:58 user nova-compute[73079]:     <acpi/>
Aug 17 15:17:58 user nova-compute[73079]:     <apic/>
Aug 17 15:17:58 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:17:58 user nova-compute[73079]:   </features>
Aug 17 15:17:58 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:17:58 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:17:58 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:17:58 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:17:58 user nova-compute[73079]:   </clock>
Aug 17 15:17:58 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:17:58 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:17:58 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:17:58 user nova-compute[73079]:   </cpu>
Aug 17 15:17:58 user nova-compute[73079]:   <devices>
Aug 17 15:17:58 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:17:58 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:17:58 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk"/>
Aug 17 15:17:58 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:17:58 user nova-compute[73079]:     </disk>
Aug 17 15:17:58 user nova-compute[73079]:     <disk type="block" device="disk">
Aug 17 15:17:58 user nova-compute[73079]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:17:58 user nova-compute[73079]:       <source dev="/dev/sdb"/>
Aug 17 15:17:58 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 15:17:58 user nova-compute[73079]:       <serial>a75aef53-21ce-49b3-a4b3-34daaedbdd02</serial>
Aug 17 15:17:58 user nova-compute[73079]:     </disk>
Aug 17 15:17:58 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:17:58 user nova-compute[73079]:       <mac address="fa:16:3e:1c:ba:55"/>
Aug 17 15:17:58 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:17:58 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:17:58 user nova-compute[73079]:       <target dev="tap9c848fbc-da"/>
Aug 17 15:17:58 user nova-compute[73079]:     </interface>
Aug 17 15:17:58 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:17:58 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/console.log" append="off"/>
Aug 17 15:17:58 user nova-compute[73079]:     </serial>
Aug 17 15:17:58 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:17:58 user nova-compute[73079]:     <video>
Aug 17 15:17:58 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:17:58 user nova-compute[73079]:     </video>
Aug 17 15:17:58 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:17:58 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:17:58 user nova-compute[73079]:     </rng>
Aug 17 15:17:58 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:17:58 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:17:58 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:17:58 user nova-compute[73079]:     </memballoon>
Aug 17 15:17:58 user nova-compute[73079]:   </devices>
Aug 17 15:17:58 user nova-compute[73079]: </domain>
Aug 17 15:17:58 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:58 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b0cf0491dfa2c6d745e5d355b909d8b23dab4f7 --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Cannot resize image /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.objects.instance [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'migration_context' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-496765803',display_name='tempest-TestMinimumBasicScenario-server-496765803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-496765803',id=46,image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkpY/JSvOaWDg47/sSzYQVO787OYmYpZ0YxmWer5h5TougqaRRjkdQ9aqrz4ErbJRTQGyGDpHqlbVEGRZmr/yGF1ubszHY4LcRCvnHqBAVGAf5DEvIp0BTvKuC02+t6w==',key_name='tempest-TestMinimumBasicScenario-160788929',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-za2dmz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:17:56Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=3b546f82-ca73-4385-afc8-93ddad1199fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG os_vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c848fbc-da, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c848fbc-da, col_values=(('external_ids', {'iface-id': '9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:ba:55', 'vm-uuid': '3b546f82-ca73-4385-afc8-93ddad1199fd'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:17:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:17:59 user nova-compute[73079]: INFO os_vif [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da')
Aug 17 15:18:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-65c5d0f7-1a94-48e5-8970-d1d47102eb6c req-92c2444b-67c2-4cb8-858f-3c05060dbee6 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-65c5d0f7-1a94-48e5-8970-d1d47102eb6c req-92c2444b-67c2-4cb8-858f-3c05060dbee6 service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-65c5d0f7-1a94-48e5-8970-d1d47102eb6c req-92c2444b-67c2-4cb8-858f-3c05060dbee6 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-65c5d0f7-1a94-48e5-8970-d1d47102eb6c req-92c2444b-67c2-4cb8-858f-3c05060dbee6 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-65c5d0f7-1a94-48e5-8970-d1d47102eb6c req-92c2444b-67c2-4cb8-858f-3c05060dbee6 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:18:00 user nova-compute[73079]: WARNING nova.compute.manager [req-65c5d0f7-1a94-48e5-8970-d1d47102eb6c req-92c2444b-67c2-4cb8-858f-3c05060dbee6 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 15:18:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 3b546f82-ca73-4385-afc8-93ddad1199fd due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285482.8643057, 3b546f82-ca73-4385-afc8-93ddad1199fd => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:18:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] VM Resumed (Lifecycle Event)
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:18:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance rebooted successfully.
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:18:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285482.8685498, 3b546f82-ca73-4385-afc8-93ddad1199fd => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:18:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] VM Started (Lifecycle Event)
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:18:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-d9d6c99a-7b8b-42b4-8185-1dd6c8f2f4ee tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.520s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-0e5a8e83-920d-41e2-94d6-d2e726b24265 req-50be8e14-a69e-4288-bcba-c7e935a07245 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0e5a8e83-920d-41e2-94d6-d2e726b24265 req-50be8e14-a69e-4288-bcba-c7e935a07245 service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0e5a8e83-920d-41e2-94d6-d2e726b24265 req-50be8e14-a69e-4288-bcba-c7e935a07245 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-0e5a8e83-920d-41e2-94d6-d2e726b24265 req-50be8e14-a69e-4288-bcba-c7e935a07245 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-0e5a8e83-920d-41e2-94d6-d2e726b24265 req-50be8e14-a69e-4288-bcba-c7e935a07245 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:18:03 user nova-compute[73079]: WARNING nova.compute.manager [req-0e5a8e83-920d-41e2-94d6-d2e726b24265 req-50be8e14-a69e-4288-bcba-c7e935a07245 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state active and task_state None.
Aug 17 15:18:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:18:17 user nova-compute[73079]: INFO nova.compute.claims [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Claim successful on node user
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.network.neutron [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:18:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.policy [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c0c88d3cad6476a87e701a4e49577ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c723398454ff3b54b35dd61fc59d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:18:17 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Creating image(s)
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6e2071e1-3534-4ad7-9058-29363700645c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:18:18 user nova-compute[73079]: INFO nova.compute.claims [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Claim successful on node user
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk 1073741824" returned: 0 in 0.053s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Successfully created port: ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.network.neutron [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:18:18 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Cannot resize image /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.objects.instance [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'migration_context' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Ensure instance console log exists: /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:18:18 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Creating image(s)
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG nova.policy [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c0c88d3cad6476a87e701a4e49577ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c723398454ff3b54b35dd61fc59d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.252s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.214s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk 1073741824" returned: 0 in 0.052s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.222s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Cannot resize image /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.objects.instance [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'migration_context' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Ensure instance console log exists: /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Successfully updated port: ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-changed-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Refreshing instance network info cache due to event network-changed-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Successfully created port: f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:18:19 user nova-compute[73079]: DEBUG nova.network.neutron [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.network.neutron [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance network_info: |[{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.network.neutron [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Refreshing network info cache for port ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Start _get_guest_xml network_info=[{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:18:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:18:20 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1817772398',display_name='tempest-ServerRescueNegativeTestJSON-server-1817772398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1817772398',id=47,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-c5nxthc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:18:18Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.objects.instance [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:18:20 user nova-compute[73079]:   <uuid>9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b</uuid>
Aug 17 15:18:20 user nova-compute[73079]:   <name>instance-0000002f</name>
Aug 17 15:18:20 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:18:20 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:18:20 user nova-compute[73079]:   <metadata>
Aug 17 15:18:20 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:18:20 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:18:20 user nova-compute[73079]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1817772398</nova:name>
Aug 17 15:18:20 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:18:20</nova:creationTime>
Aug 17 15:18:20 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:18:20 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:18:20 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:18:20 user nova-compute[73079]:       <nova:owner>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:user uuid="0c0c88d3cad6476a87e701a4e49577ac">tempest-ServerRescueNegativeTestJSON-311904791-project-member</nova:user>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:project uuid="398c723398454ff3b54b35dd61fc59d3">tempest-ServerRescueNegativeTestJSON-311904791</nova:project>
Aug 17 15:18:20 user nova-compute[73079]:       </nova:owner>
Aug 17 15:18:20 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:18:20 user nova-compute[73079]:       <nova:ports>
Aug 17 15:18:20 user nova-compute[73079]:         <nova:port uuid="ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef">
Aug 17 15:18:20 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 15:18:20 user nova-compute[73079]:         </nova:port>
Aug 17 15:18:20 user nova-compute[73079]:       </nova:ports>
Aug 17 15:18:20 user nova-compute[73079]:     </nova:instance>
Aug 17 15:18:20 user nova-compute[73079]:   </metadata>
Aug 17 15:18:20 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:18:20 user nova-compute[73079]:     <system>
Aug 17 15:18:20 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:18:20 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:18:20 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:18:20 user nova-compute[73079]:       <entry name="serial">9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b</entry>
Aug 17 15:18:20 user nova-compute[73079]:       <entry name="uuid">9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b</entry>
Aug 17 15:18:20 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:18:20 user nova-compute[73079]:     </system>
Aug 17 15:18:20 user nova-compute[73079]:   </sysinfo>
Aug 17 15:18:20 user nova-compute[73079]:   <os>
Aug 17 15:18:20 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:18:20 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:18:20 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:18:20 user nova-compute[73079]:   </os>
Aug 17 15:18:20 user nova-compute[73079]:   <features>
Aug 17 15:18:20 user nova-compute[73079]:     <acpi/>
Aug 17 15:18:20 user nova-compute[73079]:     <apic/>
Aug 17 15:18:20 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:18:20 user nova-compute[73079]:   </features>
Aug 17 15:18:20 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:18:20 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:18:20 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:18:20 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:18:20 user nova-compute[73079]:   </clock>
Aug 17 15:18:20 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:18:20 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:18:20 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:18:20 user nova-compute[73079]:   </cpu>
Aug 17 15:18:20 user nova-compute[73079]:   <devices>
Aug 17 15:18:20 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:18:20 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:18:20 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk"/>
Aug 17 15:18:20 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:18:20 user nova-compute[73079]:     </disk>
Aug 17 15:18:20 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:18:20 user nova-compute[73079]:       <mac address="fa:16:3e:1d:3f:52"/>
Aug 17 15:18:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:18:20 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:18:20 user nova-compute[73079]:       <target dev="tapef0f8b31-4b"/>
Aug 17 15:18:20 user nova-compute[73079]:     </interface>
Aug 17 15:18:20 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:18:20 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/console.log" append="off"/>
Aug 17 15:18:20 user nova-compute[73079]:     </serial>
Aug 17 15:18:20 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:18:20 user nova-compute[73079]:     <video>
Aug 17 15:18:20 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:18:20 user nova-compute[73079]:     </video>
Aug 17 15:18:20 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:18:20 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:18:20 user nova-compute[73079]:     </rng>
Aug 17 15:18:20 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:18:20 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:18:20 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:18:20 user nova-compute[73079]:     </memballoon>
Aug 17 15:18:20 user nova-compute[73079]:   </devices>
Aug 17 15:18:20 user nova-compute[73079]: </domain>
Aug 17 15:18:20 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1817772398',display_name='tempest-ServerRescueNegativeTestJSON-server-1817772398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1817772398',id=47,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-c5nxthc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:18:18Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG os_vif [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef0f8b31-4b, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef0f8b31-4b, col_values=(('external_ids', {'iface-id': 'ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:3f:52', 'vm-uuid': '9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:20 user nova-compute[73079]: INFO os_vif [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b')
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:18:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:1d:3f:52, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated VIF entry in instance network info cache for port ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-16fca83e-84bd-4410-9093-94ce17627f7b req-09979212-f4d7-45d8-9101-d27a47064e19 service nova] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Successfully updated port: f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-changed-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.compute.manager [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Refreshing instance network info cache due to event network-changed-f84e0f76-f117-4e72-9f31-2f3a4314c837. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance network_info: |[{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.neutron [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Refreshing network info cache for port f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Start _get_guest_xml network_info=[{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:18:21 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:18:21 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-676118727',display_name='tempest-ServerRescueNegativeTestJSON-server-676118727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-676118727',id=48,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-xb1ikbtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:18:19Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6e2071e1-3534-4ad7-9058-29363700645c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.objects.instance [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:18:21 user nova-compute[73079]:   <uuid>6e2071e1-3534-4ad7-9058-29363700645c</uuid>
Aug 17 15:18:21 user nova-compute[73079]:   <name>instance-00000030</name>
Aug 17 15:18:21 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:18:21 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:18:21 user nova-compute[73079]:   <metadata>
Aug 17 15:18:21 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:18:21 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:18:21 user nova-compute[73079]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-676118727</nova:name>
Aug 17 15:18:21 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:18:21</nova:creationTime>
Aug 17 15:18:21 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:18:21 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:18:21 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:18:21 user nova-compute[73079]:       <nova:owner>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:user uuid="0c0c88d3cad6476a87e701a4e49577ac">tempest-ServerRescueNegativeTestJSON-311904791-project-member</nova:user>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:project uuid="398c723398454ff3b54b35dd61fc59d3">tempest-ServerRescueNegativeTestJSON-311904791</nova:project>
Aug 17 15:18:21 user nova-compute[73079]:       </nova:owner>
Aug 17 15:18:21 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:18:21 user nova-compute[73079]:       <nova:ports>
Aug 17 15:18:21 user nova-compute[73079]:         <nova:port uuid="f84e0f76-f117-4e72-9f31-2f3a4314c837">
Aug 17 15:18:21 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:18:21 user nova-compute[73079]:         </nova:port>
Aug 17 15:18:21 user nova-compute[73079]:       </nova:ports>
Aug 17 15:18:21 user nova-compute[73079]:     </nova:instance>
Aug 17 15:18:21 user nova-compute[73079]:   </metadata>
Aug 17 15:18:21 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:18:21 user nova-compute[73079]:     <system>
Aug 17 15:18:21 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:18:21 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:18:21 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:18:21 user nova-compute[73079]:       <entry name="serial">6e2071e1-3534-4ad7-9058-29363700645c</entry>
Aug 17 15:18:21 user nova-compute[73079]:       <entry name="uuid">6e2071e1-3534-4ad7-9058-29363700645c</entry>
Aug 17 15:18:21 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:18:21 user nova-compute[73079]:     </system>
Aug 17 15:18:21 user nova-compute[73079]:   </sysinfo>
Aug 17 15:18:21 user nova-compute[73079]:   <os>
Aug 17 15:18:21 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:18:21 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:18:21 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:18:21 user nova-compute[73079]:   </os>
Aug 17 15:18:21 user nova-compute[73079]:   <features>
Aug 17 15:18:21 user nova-compute[73079]:     <acpi/>
Aug 17 15:18:21 user nova-compute[73079]:     <apic/>
Aug 17 15:18:21 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:18:21 user nova-compute[73079]:   </features>
Aug 17 15:18:21 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:18:21 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:18:21 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:18:21 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:18:21 user nova-compute[73079]:   </clock>
Aug 17 15:18:21 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:18:21 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:18:21 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:18:21 user nova-compute[73079]:   </cpu>
Aug 17 15:18:21 user nova-compute[73079]:   <devices>
Aug 17 15:18:21 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:18:21 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:18:21 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk"/>
Aug 17 15:18:21 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:18:21 user nova-compute[73079]:     </disk>
Aug 17 15:18:21 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:18:21 user nova-compute[73079]:       <mac address="fa:16:3e:12:cd:ef"/>
Aug 17 15:18:21 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:18:21 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:18:21 user nova-compute[73079]:       <target dev="tapf84e0f76-f1"/>
Aug 17 15:18:21 user nova-compute[73079]:     </interface>
Aug 17 15:18:21 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:18:21 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/console.log" append="off"/>
Aug 17 15:18:21 user nova-compute[73079]:     </serial>
Aug 17 15:18:21 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:18:21 user nova-compute[73079]:     <video>
Aug 17 15:18:21 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:18:21 user nova-compute[73079]:     </video>
Aug 17 15:18:21 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:18:21 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:18:21 user nova-compute[73079]:     </rng>
Aug 17 15:18:21 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:18:21 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:18:21 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:18:21 user nova-compute[73079]:     </memballoon>
Aug 17 15:18:21 user nova-compute[73079]:   </devices>
Aug 17 15:18:21 user nova-compute[73079]: </domain>
Aug 17 15:18:21 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-676118727',display_name='tempest-ServerRescueNegativeTestJSON-server-676118727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-676118727',id=48,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-xb1ikbtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:18:19Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6e2071e1-3534-4ad7-9058-29363700645c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG os_vif [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf84e0f76-f1, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf84e0f76-f1, col_values=(('external_ids', {'iface-id': 'f84e0f76-f117-4e72-9f31-2f3a4314c837', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:cd:ef', 'vm-uuid': '6e2071e1-3534-4ad7-9058-29363700645c'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:18:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:21 user nova-compute[73079]: INFO os_vif [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1')
Aug 17 15:18:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:12:cd:ef, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updated VIF entry in instance network info cache for port f84e0f76-f117-4e72-9f31-2f3a4314c837. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG nova.network.neutron [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-31549616-87a7-4a35-be7a-37109dba746e req-8d6904cf-23c5-4ac9-bde3-a175d8734174 service nova] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:18:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b75310b8-1d2f-4ec2-abc1-bf3a8cd2923b req-1d1b88f7-ad6d-418f-80b7-301c89d495d6 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b75310b8-1d2f-4ec2-abc1-bf3a8cd2923b req-1d1b88f7-ad6d-418f-80b7-301c89d495d6 service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b75310b8-1d2f-4ec2-abc1-bf3a8cd2923b req-1d1b88f7-ad6d-418f-80b7-301c89d495d6 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b75310b8-1d2f-4ec2-abc1-bf3a8cd2923b req-1d1b88f7-ad6d-418f-80b7-301c89d495d6 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-b75310b8-1d2f-4ec2-abc1-bf3a8cd2923b req-1d1b88f7-ad6d-418f-80b7-301c89d495d6 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:18:23 user nova-compute[73079]: WARNING nova.compute.manager [req-b75310b8-1d2f-4ec2-abc1-bf3a8cd2923b req-1d1b88f7-ad6d-418f-80b7-301c89d495d6 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state building and task_state spawning.
Aug 17 15:18:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:18:23 user nova-compute[73079]: WARNING nova.compute.manager [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state building and task_state spawning.
Aug 17 15:18:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:23 user nova-compute[73079]: DEBUG nova.compute.manager [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:18:23 user nova-compute[73079]: WARNING nova.compute.manager [req-4eafd856-b850-47b6-8ab4-4c51c62b8562 req-ac734d79-07d8-4f24-baff-bdd17a23547d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state building and task_state spawning.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285505.1083605, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Resumed (Lifecycle Event)
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance spawned successfully.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285505.1099231, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Started (Lifecycle Event)
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Took 7.45 seconds to spawn the instance on the hypervisor.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Took 8.07 seconds to build instance.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-81d44f79-d03e-44bc-abe2-2fb255caa1d9 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.161s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285505.6617954, 6e2071e1-3534-4ad7-9058-29363700645c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] VM Resumed (Lifecycle Event)
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance spawned successfully.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285505.663188, 6e2071e1-3534-4ad7-9058-29363700645c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] VM Started (Lifecycle Event)
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Took 7.16 seconds to spawn the instance on the hypervisor.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-eed41cc7-1d45-43fd-8b96-90b3f12f14e2 req-6de65e63-d30e-470f-ac12-5aaa3b17ff5c service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-eed41cc7-1d45-43fd-8b96-90b3f12f14e2 req-6de65e63-d30e-470f-ac12-5aaa3b17ff5c service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-eed41cc7-1d45-43fd-8b96-90b3f12f14e2 req-6de65e63-d30e-470f-ac12-5aaa3b17ff5c service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-eed41cc7-1d45-43fd-8b96-90b3f12f14e2 req-6de65e63-d30e-470f-ac12-5aaa3b17ff5c service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:25 user nova-compute[73079]: DEBUG nova.compute.manager [req-eed41cc7-1d45-43fd-8b96-90b3f12f14e2 req-6de65e63-d30e-470f-ac12-5aaa3b17ff5c service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:18:25 user nova-compute[73079]: WARNING nova.compute.manager [req-eed41cc7-1d45-43fd-8b96-90b3f12f14e2 req-6de65e63-d30e-470f-ac12-5aaa3b17ff5c service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state building and task_state spawning.
Aug 17 15:18:25 user nova-compute[73079]: INFO nova.compute.manager [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Took 7.92 seconds to build instance.
Aug 17 15:18:25 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-99b19d44-bd5b-4d86-b217-6b2c1c8fede2 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6e2071e1-3534-4ad7-9058-29363700645c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.013s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:29 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:18:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:18:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:18:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:18:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:18:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8438MB free_disk=25.26797103881836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:18:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:18:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:18:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:18:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:18:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:19:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:19:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:19:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:19:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:19:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:19:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:19:31 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:19:33 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:33 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:19:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:19:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:37 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:19:38 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:19:38 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=25.21178436279297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:19:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:19:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:19:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing instance network info cache due to event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:19:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated VIF entry in instance network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a019456-1067-4246-ac6f-ae1fa026ff91 req-a4118c67-1b8b-4b1c-9e7f-50747d8c05ef service nova] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing instance network info cache due to event network-changed-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] Acquiring lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] Acquired lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Refreshing network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:19:48 user nova-compute[73079]: INFO nova.compute.manager [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Detaching volume a75aef53-21ce-49b3-a4b3-34daaedbdd02
Aug 17 15:19:48 user nova-compute[73079]: INFO nova.virt.block_device [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Attempting to driver detach volume a75aef53-21ce-49b3-a4b3-34daaedbdd02 from mountpoint /dev/vdb
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Attempting to detach device vdb from instance 3b546f82-ca73-4385-afc8-93ddad1199fd from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:19:48 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:19:48 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:19:48 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:19:48 user nova-compute[73079]:   <serial>a75aef53-21ce-49b3-a4b3-34daaedbdd02</serial>
Aug 17 15:19:48 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 15:19:48 user nova-compute[73079]: </disk>
Aug 17 15:19:48 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:19:48 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully detached device vdb from instance 3b546f82-ca73-4385-afc8-93ddad1199fd from the persistent domain config.
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b546f82-ca73-4385-afc8-93ddad1199fd from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:19:48 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:19:48 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:19:48 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:19:48 user nova-compute[73079]:   <serial>a75aef53-21ce-49b3-a4b3-34daaedbdd02</serial>
Aug 17 15:19:48 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 15:19:48 user nova-compute[73079]: </disk>
Aug 17 15:19:48 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updated VIF entry in instance network info cache for port 9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [{"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:19:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-40d99d1e-475d-4c56-8e10-c9b93d727003 req-8e3e17bf-d640-47ae-9dc5-d16821a0e8eb service nova] Releasing lock "refresh_cache-3b546f82-ca73-4385-afc8-93ddad1199fd" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692285589.0692153, 3b546f82-ca73-4385-afc8-93ddad1199fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:19:49 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully detached device vdb from instance 3b546f82-ca73-4385-afc8-93ddad1199fd from the live domain config.
Aug 17 15:19:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBvEoTwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:19:49 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b75cbc-ea5f-488f-9935-2c28a645b6d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17d3237-d026-4de4-8291-623b7e136928]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:19:49 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 (non-flash)
Aug 17 15:19:49 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c85cd6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00667ed-3f20-4292-9b7f-10c3638ba5f2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f968050f-ff98-4313-a493-b2a57bfe03a2]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd7350-3c0e-4354-af57-5faca9ed4a76]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b07092-055b-43eb-8e08-9b725869fd64]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bf02e2-9b62-4bea-a104-009da4f4c1c4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6d178-4205-4a3f-a318-3e0bbadc111b]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260]
Aug 17 15:19:49 user nova-compute[73079]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02, portal: 172.16.0.220,3260] successful.
Aug 17 15:19:49 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a75aef53-21ce-49b3-a4b3-34daaedbdd02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f937b-3917-4592-9927-0aa2b01580ef]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== disconnect_volume: return (255ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:19:49 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:19:50 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'flavor' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:19:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a3e34f9c-1637-4999-9251-91b31dba4c80 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.768s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:19:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:19:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:20:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:20:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:20:07 user nova-compute[73079]: INFO nova.compute.manager [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Rescuing
Aug 17 15:20:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:20:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:20:07 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG nova.network.neutron [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-e8335273-c156-416d-9e78-dbd6de246e37 req-a78cb1a0-aa41-4eba-81f5-7793c777b1ce service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-unplugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e8335273-c156-416d-9e78-dbd6de246e37 req-a78cb1a0-aa41-4eba-81f5-7793c777b1ce service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e8335273-c156-416d-9e78-dbd6de246e37 req-a78cb1a0-aa41-4eba-81f5-7793c777b1ce service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e8335273-c156-416d-9e78-dbd6de246e37 req-a78cb1a0-aa41-4eba-81f5-7793c777b1ce service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-e8335273-c156-416d-9e78-dbd6de246e37 req-a78cb1a0-aa41-4eba-81f5-7793c777b1ce service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-unplugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:20:08 user nova-compute[73079]: WARNING nova.compute.manager [req-e8335273-c156-416d-9e78-dbd6de246e37 req-a78cb1a0-aa41-4eba-81f5-7793c777b1ce service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-unplugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state active and task_state rescuing.
Aug 17 15:20:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance destroyed successfully.
Aug 17 15:20:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Attempting rescue
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73079) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 15:20:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Creating image(s)
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'migration_context' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Start _get_guest_xml network_info=[{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:12:cd:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'resources' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:20:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-676118727',display_name='tempest-ServerRescueNegativeTestJSON-server-676118727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-676118727',id=48,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-xb1ikbtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:18:26Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6e2071e1-3534-4ad7-9058-29363700645c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:12:cd:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:12:cd:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:20:09 user nova-compute[73079]:   <uuid>6e2071e1-3534-4ad7-9058-29363700645c</uuid>
Aug 17 15:20:09 user nova-compute[73079]:   <name>instance-00000030</name>
Aug 17 15:20:09 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:20:09 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:20:09 user nova-compute[73079]:   <metadata>
Aug 17 15:20:09 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:20:09 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:20:09 user nova-compute[73079]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-676118727</nova:name>
Aug 17 15:20:09 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:20:09</nova:creationTime>
Aug 17 15:20:09 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:20:09 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:20:09 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:20:09 user nova-compute[73079]:       <nova:owner>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:user uuid="0c0c88d3cad6476a87e701a4e49577ac">tempest-ServerRescueNegativeTestJSON-311904791-project-member</nova:user>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:project uuid="398c723398454ff3b54b35dd61fc59d3">tempest-ServerRescueNegativeTestJSON-311904791</nova:project>
Aug 17 15:20:09 user nova-compute[73079]:       </nova:owner>
Aug 17 15:20:09 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:20:09 user nova-compute[73079]:       <nova:ports>
Aug 17 15:20:09 user nova-compute[73079]:         <nova:port uuid="f84e0f76-f117-4e72-9f31-2f3a4314c837">
Aug 17 15:20:09 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 15:20:09 user nova-compute[73079]:         </nova:port>
Aug 17 15:20:09 user nova-compute[73079]:       </nova:ports>
Aug 17 15:20:09 user nova-compute[73079]:     </nova:instance>
Aug 17 15:20:09 user nova-compute[73079]:   </metadata>
Aug 17 15:20:09 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:20:09 user nova-compute[73079]:     <system>
Aug 17 15:20:09 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:20:09 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:20:09 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:20:09 user nova-compute[73079]:       <entry name="serial">6e2071e1-3534-4ad7-9058-29363700645c</entry>
Aug 17 15:20:09 user nova-compute[73079]:       <entry name="uuid">6e2071e1-3534-4ad7-9058-29363700645c</entry>
Aug 17 15:20:09 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:20:09 user nova-compute[73079]:     </system>
Aug 17 15:20:09 user nova-compute[73079]:   </sysinfo>
Aug 17 15:20:09 user nova-compute[73079]:   <os>
Aug 17 15:20:09 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:20:09 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:20:09 user nova-compute[73079]:   </os>
Aug 17 15:20:09 user nova-compute[73079]:   <features>
Aug 17 15:20:09 user nova-compute[73079]:     <acpi/>
Aug 17 15:20:09 user nova-compute[73079]:     <apic/>
Aug 17 15:20:09 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:20:09 user nova-compute[73079]:   </features>
Aug 17 15:20:09 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:20:09 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:20:09 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:20:09 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:20:09 user nova-compute[73079]:   </clock>
Aug 17 15:20:09 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:20:09 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:20:09 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:20:09 user nova-compute[73079]:   </cpu>
Aug 17 15:20:09 user nova-compute[73079]:   <devices>
Aug 17 15:20:09 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:20:09 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:20:09 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue"/>
Aug 17 15:20:09 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:20:09 user nova-compute[73079]:     </disk>
Aug 17 15:20:09 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:20:09 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:20:09 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk"/>
Aug 17 15:20:09 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 15:20:09 user nova-compute[73079]:     </disk>
Aug 17 15:20:09 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:20:09 user nova-compute[73079]:       <mac address="fa:16:3e:12:cd:ef"/>
Aug 17 15:20:09 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:20:09 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:20:09 user nova-compute[73079]:       <target dev="tapf84e0f76-f1"/>
Aug 17 15:20:09 user nova-compute[73079]:     </interface>
Aug 17 15:20:09 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:20:09 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/console.log" append="off"/>
Aug 17 15:20:09 user nova-compute[73079]:     </serial>
Aug 17 15:20:09 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:20:09 user nova-compute[73079]:     <video>
Aug 17 15:20:09 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:20:09 user nova-compute[73079]:     </video>
Aug 17 15:20:09 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:20:09 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:20:09 user nova-compute[73079]:     </rng>
Aug 17 15:20:09 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:20:09 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:20:09 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:20:09 user nova-compute[73079]:     </memballoon>
Aug 17 15:20:09 user nova-compute[73079]:   </devices>
Aug 17 15:20:09 user nova-compute[73079]: </domain>
Aug 17 15:20:09 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:20:09 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance destroyed successfully.
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:20:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:12:cd:ef, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:20:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-72a45e13-7036-46b6-b712-4cec323799cb req-b28bb739-8a66-49be-a0f8-f442c59a79cb service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72a45e13-7036-46b6-b712-4cec323799cb req-b28bb739-8a66-49be-a0f8-f442c59a79cb service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72a45e13-7036-46b6-b712-4cec323799cb req-b28bb739-8a66-49be-a0f8-f442c59a79cb service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-72a45e13-7036-46b6-b712-4cec323799cb req-b28bb739-8a66-49be-a0f8-f442c59a79cb service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:10 user nova-compute[73079]: DEBUG nova.compute.manager [req-72a45e13-7036-46b6-b712-4cec323799cb req-b28bb739-8a66-49be-a0f8-f442c59a79cb service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:20:10 user nova-compute[73079]: WARNING nova.compute.manager [req-72a45e13-7036-46b6-b712-4cec323799cb req-b28bb739-8a66-49be-a0f8-f442c59a79cb service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state active and task_state rescuing.
Aug 17 15:20:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:20:12 user nova-compute[73079]: WARNING nova.compute.manager [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state active and task_state rescuing.
Aug 17 15:20:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:12 user nova-compute[73079]: DEBUG nova.compute.manager [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:20:12 user nova-compute[73079]: WARNING nova.compute.manager [req-09136f5b-bb19-4e6a-ba9c-81e3ff8a1e1f req-da129f25-1a88-4ee1-bca4-1d2406fe51b2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state active and task_state rescuing.
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 6e2071e1-3534-4ad7-9058-29363700645c due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285613.1537447, 6e2071e1-3534-4ad7-9058-29363700645c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:20:13 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] VM Resumed (Lifecycle Event)
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c9000744-8172-493f-ac55-cc0a1f529216 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:20:13 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285613.1562366, 6e2071e1-3534-4ad7-9058-29363700645c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:20:13 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] VM Started (Lifecycle Event)
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:20:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:20:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:20:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:20:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:20:38 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:39 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:20:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:20:41 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:20:41 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=25.209861755371094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 3b546f82-ca73-4385-afc8-93ddad1199fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:20:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:45 user nova-compute[73079]: INFO nova.compute.manager [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Terminating instance
Aug 17 15:20:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-c9c03f79-5820-405c-9006-1400aa88a7c9 req-278f211f-75be-4d45-82f4-e790cd81d98d service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-unplugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c9c03f79-5820-405c-9006-1400aa88a7c9 req-278f211f-75be-4d45-82f4-e790cd81d98d service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c9c03f79-5820-405c-9006-1400aa88a7c9 req-278f211f-75be-4d45-82f4-e790cd81d98d service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c9c03f79-5820-405c-9006-1400aa88a7c9 req-278f211f-75be-4d45-82f4-e790cd81d98d service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-c9c03f79-5820-405c-9006-1400aa88a7c9 req-278f211f-75be-4d45-82f4-e790cd81d98d service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-unplugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:20:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-c9c03f79-5820-405c-9006-1400aa88a7c9 req-278f211f-75be-4d45-82f4-e790cd81d98d service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-unplugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:20:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Instance destroyed successfully.
Aug 17 15:20:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'resources' on Instance uuid 3b546f82-ca73-4385-afc8-93ddad1199fd {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-496765803',display_name='tempest-TestMinimumBasicScenario-server-496765803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-496765803',id=46,image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkpY/JSvOaWDg47/sSzYQVO787OYmYpZ0YxmWer5h5TougqaRRjkdQ9aqrz4ErbJRTQGyGDpHqlbVEGRZmr/yGF1ubszHY4LcRCvnHqBAVGAf5DEvIp0BTvKuC02+t6w==',key_name='tempest-TestMinimumBasicScenario-160788929',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-za2dmz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9afe607-5373-4efb-ad72-93e68cae582c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:18:03Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=3b546f82-ca73-4385-afc8-93ddad1199fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "address": "fa:16:3e:1c:ba:55", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c848fbc-da", "ovs_interfaceid": "9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG os_vif [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c848fbc-da, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:20:46 user nova-compute[73079]: INFO os_vif [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:ba:55,bridge_name='br-int',has_traffic_filtering=True,id=9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c848fbc-da')
Aug 17 15:20:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Deleting instance files /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd_del
Aug 17 15:20:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Deletion of /opt/stack/data/nova/instances/3b546f82-ca73-4385-afc8-93ddad1199fd_del complete
Aug 17 15:20:46 user nova-compute[73079]: INFO nova.compute.manager [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 15:20:46 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:20:46 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:20:47 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Took 0.76 seconds to deallocate network for instance.
Aug 17 15:20:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-f1c2d939-491e-4d56-a281-59efd16d01ce req-904a33e0-1683-4cf8-a436-0a1bf9067d03 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-deleted-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:47 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Deleted allocations for instance 3b546f82-ca73-4385-afc8-93ddad1199fd
Aug 17 15:20:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-3287a1ca-3151-4630-acec-b639f1beb012 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-d0a041c2-b9be-4589-8ba6-368382c99dfb req-12da7ca3-19e0-499f-ad40-4a6b32373ab3 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:20:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d0a041c2-b9be-4589-8ba6-368382c99dfb req-12da7ca3-19e0-499f-ad40-4a6b32373ab3 service nova] Acquiring lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:20:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d0a041c2-b9be-4589-8ba6-368382c99dfb req-12da7ca3-19e0-499f-ad40-4a6b32373ab3 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:20:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d0a041c2-b9be-4589-8ba6-368382c99dfb req-12da7ca3-19e0-499f-ad40-4a6b32373ab3 service nova] Lock "3b546f82-ca73-4385-afc8-93ddad1199fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:20:48 user nova-compute[73079]: DEBUG nova.compute.manager [req-d0a041c2-b9be-4589-8ba6-368382c99dfb req-12da7ca3-19e0-499f-ad40-4a6b32373ab3 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] No waiting events found dispatching network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:20:48 user nova-compute[73079]: WARNING nova.compute.manager [req-d0a041c2-b9be-4589-8ba6-368382c99dfb req-12da7ca3-19e0-499f-ad40-4a6b32373ab3 service nova] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Received unexpected event network-vif-plugged-9c848fbc-dad4-4e3b-bdbe-81b88ad1a3f6 for instance with vm_state deleted and task_state None.
Aug 17 15:20:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:20:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692285646.1811635, 3b546f82-ca73-4385-afc8-93ddad1199fd => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:21:01 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] VM Stopped (Lifecycle Event)
Aug 17 15:21:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-dac407f2-d942-4948-9cd0-831ef6100585 None None] [instance: 3b546f82-ca73-4385-afc8-93ddad1199fd] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:21:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:23 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:21:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:21:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:21:40 user nova-compute[73079]: INFO nova.compute.claims [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Claim successful on node user
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.120s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:21:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.policy [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '392ac56ddb824b94bb1c7743f7241313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206af61bece947499bacc93c93f73da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:21:40 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Creating image(s)
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "/opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "/opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "22825acc416ca9469d31457513a1ad0ea6f79ebf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:40 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "22825acc416ca9469d31457513a1ad0ea6f79ebf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.752s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG nova.virt.images [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] 7efe0cf2-3d56-433c-ab94-2ad273eb5c33 was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.part /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Successfully created port: 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.part /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.converted" returned: 0 in 0.225s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "22825acc416ca9469d31457513a1ad0ea6f79ebf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.216s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:41 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "22825acc416ca9469d31457513a1ad0ea6f79ebf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "22825acc416ca9469d31457513a1ad0ea6f79ebf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf,backing_fmt=raw /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf,backing_fmt=raw /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk 1073741824" returned: 0 in 0.048s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "22825acc416ca9469d31457513a1ad0ea6f79ebf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Successfully updated port: 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing instance network info cache due to event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22825acc416ca9469d31457513a1ad0ea6f79ebf --force-share --output=json" returned: 0 in 0.458s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:21:42 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:21:42 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.248905181884766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.network.neutron [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:21:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Cannot resize image /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'migration_context' on Instance uuid cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Ensure instance console log exists: /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-48cd9e6b-7801-44cb-910a-35b48f78374c req-d0df47d9-47ca-4c17-a703-e7e8375d51da service nova] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance network_info: |[{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Start _get_guest_xml network_info=[{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T15:21:37Z,direct_url=<?>,disk_format='qcow2',id=7efe0cf2-3d56-433c-ab94-2ad273eb5c33,min_disk=0,min_ram=0,name='tempest-scenario-img--766762724',owner='206af61bece947499bacc93c93f73da7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T15:21:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '7efe0cf2-3d56-433c-ab94-2ad273eb5c33'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:21:43 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:21:43 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T15:21:37Z,direct_url=<?>,disk_format='qcow2',id=7efe0cf2-3d56-433c-ab94-2ad273eb5c33,min_disk=0,min_ram=0,name='tempest-scenario-img--766762724',owner='206af61bece947499bacc93c93f73da7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T15:21:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1587545535',display_name='tempest-TestMinimumBasicScenario-server-1587545535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1587545535',id=49,image_ref='7efe0cf2-3d56-433c-ab94-2ad273eb5c33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMgJhh14xAiIJi1PFHI2q9FM5qkqmrqT79mzWvu+0VodmeJAwSbZFtV+8qkzJLPphx8Tf6iocrUTc1JdLLDsbE+lLzusnVceSFXPe52WFg/eOu1eOskgcWL1L7/Iep68Q==',key_name='tempest-TestMinimumBasicScenario-1960169664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-ulp0rpsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7efe0cf2-3d56-433c-ab94-2ad273eb5c33',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:21:41Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=cd6a0642-1876-4a0c-9bd1-0c25e5789666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.objects.instance [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'pci_devices' on Instance uuid cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:21:43 user nova-compute[73079]:   <uuid>cd6a0642-1876-4a0c-9bd1-0c25e5789666</uuid>
Aug 17 15:21:43 user nova-compute[73079]:   <name>instance-00000031</name>
Aug 17 15:21:43 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:21:43 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:21:43 user nova-compute[73079]:   <metadata>
Aug 17 15:21:43 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:21:43 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:21:43 user nova-compute[73079]:       <nova:name>tempest-TestMinimumBasicScenario-server-1587545535</nova:name>
Aug 17 15:21:43 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:21:43</nova:creationTime>
Aug 17 15:21:43 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:21:43 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:21:43 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:21:43 user nova-compute[73079]:       <nova:owner>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:user uuid="392ac56ddb824b94bb1c7743f7241313">tempest-TestMinimumBasicScenario-104665342-project-member</nova:user>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:project uuid="206af61bece947499bacc93c93f73da7">tempest-TestMinimumBasicScenario-104665342</nova:project>
Aug 17 15:21:43 user nova-compute[73079]:       </nova:owner>
Aug 17 15:21:43 user nova-compute[73079]:       <nova:root type="image" uuid="7efe0cf2-3d56-433c-ab94-2ad273eb5c33"/>
Aug 17 15:21:43 user nova-compute[73079]:       <nova:ports>
Aug 17 15:21:43 user nova-compute[73079]:         <nova:port uuid="6ad8e9ef-03be-47ad-9914-a66bc86321d8">
Aug 17 15:21:43 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 15:21:43 user nova-compute[73079]:         </nova:port>
Aug 17 15:21:43 user nova-compute[73079]:       </nova:ports>
Aug 17 15:21:43 user nova-compute[73079]:     </nova:instance>
Aug 17 15:21:43 user nova-compute[73079]:   </metadata>
Aug 17 15:21:43 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:21:43 user nova-compute[73079]:     <system>
Aug 17 15:21:43 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:21:43 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:21:43 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:21:43 user nova-compute[73079]:       <entry name="serial">cd6a0642-1876-4a0c-9bd1-0c25e5789666</entry>
Aug 17 15:21:43 user nova-compute[73079]:       <entry name="uuid">cd6a0642-1876-4a0c-9bd1-0c25e5789666</entry>
Aug 17 15:21:43 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:21:43 user nova-compute[73079]:     </system>
Aug 17 15:21:43 user nova-compute[73079]:   </sysinfo>
Aug 17 15:21:43 user nova-compute[73079]:   <os>
Aug 17 15:21:43 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:21:43 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:21:43 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:21:43 user nova-compute[73079]:   </os>
Aug 17 15:21:43 user nova-compute[73079]:   <features>
Aug 17 15:21:43 user nova-compute[73079]:     <acpi/>
Aug 17 15:21:43 user nova-compute[73079]:     <apic/>
Aug 17 15:21:43 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:21:43 user nova-compute[73079]:   </features>
Aug 17 15:21:43 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:21:43 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:21:43 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:21:43 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:21:43 user nova-compute[73079]:   </clock>
Aug 17 15:21:43 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:21:43 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:21:43 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:21:43 user nova-compute[73079]:   </cpu>
Aug 17 15:21:43 user nova-compute[73079]:   <devices>
Aug 17 15:21:43 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:21:43 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:21:43 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk"/>
Aug 17 15:21:43 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:21:43 user nova-compute[73079]:     </disk>
Aug 17 15:21:43 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:21:43 user nova-compute[73079]:       <mac address="fa:16:3e:7b:e0:8e"/>
Aug 17 15:21:43 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:21:43 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:21:43 user nova-compute[73079]:       <target dev="tap6ad8e9ef-03"/>
Aug 17 15:21:43 user nova-compute[73079]:     </interface>
Aug 17 15:21:43 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:21:43 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/console.log" append="off"/>
Aug 17 15:21:43 user nova-compute[73079]:     </serial>
Aug 17 15:21:43 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:21:43 user nova-compute[73079]:     <video>
Aug 17 15:21:43 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:21:43 user nova-compute[73079]:     </video>
Aug 17 15:21:43 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:21:43 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:21:43 user nova-compute[73079]:     </rng>
Aug 17 15:21:43 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:21:43 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:21:43 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:21:43 user nova-compute[73079]:     </memballoon>
Aug 17 15:21:43 user nova-compute[73079]:   </devices>
Aug 17 15:21:43 user nova-compute[73079]: </domain>
Aug 17 15:21:43 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1587545535',display_name='tempest-TestMinimumBasicScenario-server-1587545535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1587545535',id=49,image_ref='7efe0cf2-3d56-433c-ab94-2ad273eb5c33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMgJhh14xAiIJi1PFHI2q9FM5qkqmrqT79mzWvu+0VodmeJAwSbZFtV+8qkzJLPphx8Tf6iocrUTc1JdLLDsbE+lLzusnVceSFXPe52WFg/eOu1eOskgcWL1L7/Iep68Q==',key_name='tempest-TestMinimumBasicScenario-1960169664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-ulp0rpsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7efe0cf2-3d56-433c-ab94-2ad273eb5c33',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:21:41Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=cd6a0642-1876-4a0c-9bd1-0c25e5789666,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG os_vif [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ad8e9ef-03, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ad8e9ef-03, col_values=(('external_ids', {'iface-id': '6ad8e9ef-03be-47ad-9914-a66bc86321d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:e0:8e', 'vm-uuid': 'cd6a0642-1876-4a0c-9bd1-0c25e5789666'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:43 user nova-compute[73079]: INFO os_vif [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03')
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:21:43 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No VIF found with MAC fa:16:3e:7b:e0:8e, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:21:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2ea6cc6-786b-4b13-b1e7-3dc052410b2d req-80a1e423-0c48-4900-a33d-2bad785b9b52 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2ea6cc6-786b-4b13-b1e7-3dc052410b2d req-80a1e423-0c48-4900-a33d-2bad785b9b52 service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2ea6cc6-786b-4b13-b1e7-3dc052410b2d req-80a1e423-0c48-4900-a33d-2bad785b9b52 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a2ea6cc6-786b-4b13-b1e7-3dc052410b2d req-80a1e423-0c48-4900-a33d-2bad785b9b52 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-a2ea6cc6-786b-4b13-b1e7-3dc052410b2d req-80a1e423-0c48-4900-a33d-2bad785b9b52 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:21:45 user nova-compute[73079]: WARNING nova.compute.manager [req-a2ea6cc6-786b-4b13-b1e7-3dc052410b2d req-80a1e423-0c48-4900-a33d-2bad785b9b52 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state building and task_state spawning.
Aug 17 15:21:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:21:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285707.0557008, cd6a0642-1876-4a0c-9bd1-0c25e5789666 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] VM Resumed (Lifecycle Event)
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance spawned successfully.
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285707.057544, cd6a0642-1876-4a0c-9bd1-0c25e5789666 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] VM Started (Lifecycle Event)
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:21:47 user nova-compute[73079]: INFO nova.compute.manager [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Took 7.14 seconds to build instance.
Aug 17 15:21:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-1b1990f9-38f0-4d0a-a565-2166cdfecd0f tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.340s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-1dc7f41f-323e-4f84-970f-512a3f761df1 req-94157f20-00e8-40e4-97e5-95854915e621 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1dc7f41f-323e-4f84-970f-512a3f761df1 req-94157f20-00e8-40e4-97e5-95854915e621 service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1dc7f41f-323e-4f84-970f-512a3f761df1 req-94157f20-00e8-40e4-97e5-95854915e621 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1dc7f41f-323e-4f84-970f-512a3f761df1 req-94157f20-00e8-40e4-97e5-95854915e621 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:21:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-1dc7f41f-323e-4f84-970f-512a3f761df1 req-94157f20-00e8-40e4-97e5-95854915e621 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:21:47 user nova-compute[73079]: WARNING nova.compute.manager [req-1dc7f41f-323e-4f84-970f-512a3f761df1 req-94157f20-00e8-40e4-97e5-95854915e621 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state active and task_state None.
Aug 17 15:21:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:21:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:21:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:21:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:21:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:21:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:20 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:22:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:22:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:22:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:22:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:22:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:22:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:34 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:35 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:22:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:22:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:22:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:22:41 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:42 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:22:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:44 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:22:44 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=25.178768157958984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:22:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:22:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:22:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:22:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:22:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:22:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:22:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:22:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:02 user nova-compute[73079]: INFO nova.compute.manager [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Rescuing
Aug 17 15:23:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:23:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:23:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG nova.network.neutron [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-fac9a788-42ba-4791-957c-ecc6c2d2eec8 req-d066a8fc-b22d-475f-91ed-96aea14d8f2d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fac9a788-42ba-4791-957c-ecc6c2d2eec8 req-d066a8fc-b22d-475f-91ed-96aea14d8f2d service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fac9a788-42ba-4791-957c-ecc6c2d2eec8 req-d066a8fc-b22d-475f-91ed-96aea14d8f2d service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-fac9a788-42ba-4791-957c-ecc6c2d2eec8 req-d066a8fc-b22d-475f-91ed-96aea14d8f2d service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-fac9a788-42ba-4791-957c-ecc6c2d2eec8 req-d066a8fc-b22d-475f-91ed-96aea14d8f2d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:03 user nova-compute[73079]: WARNING nova.compute.manager [req-fac9a788-42ba-4791-957c-ecc6c2d2eec8 req-d066a8fc-b22d-475f-91ed-96aea14d8f2d service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance destroyed successfully.
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Attempting rescue
Aug 17 15:23:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73079) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 15:23:03 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Creating image(s)
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue" returned: 0 in 0.050s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'migration_context' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Start _get_guest_xml network_info=[{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:1d:3f:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'resources' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:23:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1817772398',display_name='tempest-ServerRescueNegativeTestJSON-server-1817772398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1817772398',id=47,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:18:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-c5nxthc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:18:25Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:1d:3f:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:1d:3f:52"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:23:04 user nova-compute[73079]:   <uuid>9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b</uuid>
Aug 17 15:23:04 user nova-compute[73079]:   <name>instance-0000002f</name>
Aug 17 15:23:04 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:23:04 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:23:04 user nova-compute[73079]:   <metadata>
Aug 17 15:23:04 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:23:04 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:23:04 user nova-compute[73079]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1817772398</nova:name>
Aug 17 15:23:04 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:23:04</nova:creationTime>
Aug 17 15:23:04 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:23:04 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:23:04 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:23:04 user nova-compute[73079]:       <nova:owner>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:user uuid="0c0c88d3cad6476a87e701a4e49577ac">tempest-ServerRescueNegativeTestJSON-311904791-project-member</nova:user>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:project uuid="398c723398454ff3b54b35dd61fc59d3">tempest-ServerRescueNegativeTestJSON-311904791</nova:project>
Aug 17 15:23:04 user nova-compute[73079]:       </nova:owner>
Aug 17 15:23:04 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:23:04 user nova-compute[73079]:       <nova:ports>
Aug 17 15:23:04 user nova-compute[73079]:         <nova:port uuid="ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef">
Aug 17 15:23:04 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 15:23:04 user nova-compute[73079]:         </nova:port>
Aug 17 15:23:04 user nova-compute[73079]:       </nova:ports>
Aug 17 15:23:04 user nova-compute[73079]:     </nova:instance>
Aug 17 15:23:04 user nova-compute[73079]:   </metadata>
Aug 17 15:23:04 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:23:04 user nova-compute[73079]:     <system>
Aug 17 15:23:04 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:23:04 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:23:04 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:23:04 user nova-compute[73079]:       <entry name="serial">9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b</entry>
Aug 17 15:23:04 user nova-compute[73079]:       <entry name="uuid">9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b</entry>
Aug 17 15:23:04 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:23:04 user nova-compute[73079]:     </system>
Aug 17 15:23:04 user nova-compute[73079]:   </sysinfo>
Aug 17 15:23:04 user nova-compute[73079]:   <os>
Aug 17 15:23:04 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:23:04 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:23:04 user nova-compute[73079]:   </os>
Aug 17 15:23:04 user nova-compute[73079]:   <features>
Aug 17 15:23:04 user nova-compute[73079]:     <acpi/>
Aug 17 15:23:04 user nova-compute[73079]:     <apic/>
Aug 17 15:23:04 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:23:04 user nova-compute[73079]:   </features>
Aug 17 15:23:04 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:23:04 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:23:04 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:23:04 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:23:04 user nova-compute[73079]:   </clock>
Aug 17 15:23:04 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:23:04 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:23:04 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:23:04 user nova-compute[73079]:   </cpu>
Aug 17 15:23:04 user nova-compute[73079]:   <devices>
Aug 17 15:23:04 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:23:04 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:23:04 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue"/>
Aug 17 15:23:04 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:23:04 user nova-compute[73079]:     </disk>
Aug 17 15:23:04 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:23:04 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:23:04 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk"/>
Aug 17 15:23:04 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 15:23:04 user nova-compute[73079]:     </disk>
Aug 17 15:23:04 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:23:04 user nova-compute[73079]:       <mac address="fa:16:3e:1d:3f:52"/>
Aug 17 15:23:04 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:23:04 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:23:04 user nova-compute[73079]:       <target dev="tapef0f8b31-4b"/>
Aug 17 15:23:04 user nova-compute[73079]:     </interface>
Aug 17 15:23:04 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:23:04 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/console.log" append="off"/>
Aug 17 15:23:04 user nova-compute[73079]:     </serial>
Aug 17 15:23:04 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:23:04 user nova-compute[73079]:     <video>
Aug 17 15:23:04 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:23:04 user nova-compute[73079]:     </video>
Aug 17 15:23:04 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:23:04 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:23:04 user nova-compute[73079]:     </rng>
Aug 17 15:23:04 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:23:04 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:23:04 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:23:04 user nova-compute[73079]:     </memballoon>
Aug 17 15:23:04 user nova-compute[73079]:   </devices>
Aug 17 15:23:04 user nova-compute[73079]: </domain>
Aug 17 15:23:04 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:23:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance destroyed successfully.
Aug 17 15:23:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:23:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:1d:3f:52, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:05 user nova-compute[73079]: WARNING nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:05 user nova-compute[73079]: WARNING nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:05 user nova-compute[73079]: WARNING nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:05 user nova-compute[73079]: WARNING nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:05 user nova-compute[73079]: WARNING nova.compute.manager [req-d7cce1f0-dcd5-4a2b-a59c-fff72df3a4ea req-842d98ef-b6e1-4178-94e1-34527b6722dc service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:07 user nova-compute[73079]: WARNING nova.compute.manager [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:07 user nova-compute[73079]: WARNING nova.compute.manager [req-d890d8ef-8012-490e-8cbe-4eb544d29c8b req-018f42f1-9b6e-43d7-88a1-e31e0bf8e166 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state rescuing.
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285787.6497526, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:23:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Resumed (Lifecycle Event)
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-e7b99c16-d70c-4d80-8ca8-430fa90d8e1e tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:23:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285787.6522121, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:23:07 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Started (Lifecycle Event)
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:23:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:23:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'flavor' on Instance uuid cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:34 user nova-compute[73079]: INFO nova.compute.manager [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Attaching volume 59da9b80-7435-48b2-846c-2bdfa260bc54 to /dev/vdb
Aug 17 15:23:34 user nova-compute[73079]: DEBUG os_brick.utils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d429ca-95c6-4ea2-a0b7-3bef22dc5a73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[78637973-787d-4598-a081-074f1d5bedc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e364fb-b9b4-4842-aad9-8e5a8d674c65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f515b1c9-c602-472a-9b75-431ff0dd9f79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:23:34 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:23:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c6c242-6fa9-4108-96ad-337eb4efa30a]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG os_brick.utils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:23:34 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating existing volume attachment record: d8a55065-9956-4ba0-97f0-b3101ace84fb {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:23:36 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:37 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:37 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:23:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:23:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivtYUPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:23:44 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:23:44 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:23:44 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[122ee757-2ced-436d-a9fd-140043e6a0c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:23:44 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7dc048-3223-440e-9d74-67af646aaa48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54] added
Aug 17 15:23:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[50968264-948b-4855-87d4-b20bba55a88d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa19aa2d-9e46-4966-93c8-d10025ad6c8a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivtYUPpK {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivtYUPpK" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8cae81-959c-481d-aabb-16f4b88f505d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ivtYUPpK'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3dca20-349e-4c76-befb-25c4a7405fb9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[77559408-965f-433e-85df-62d0b06d06bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:23:44 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:23:44 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:23:44 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:23:44 user nova-compute[73079]: 
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[39692736-8c4c-4850-830b-8cecf0af9ea3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260]
Aug 17 15:23:44 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260] successful.
Aug 17 15:23:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c31c39-6b8a-4867-a8d7-5a3cd9fb40bc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b732ca6-1312-4e92-8c9d-28b5fc280bf8]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 (non-flash)
Aug 17 15:23:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 (non-flash)
Aug 17 15:23:44 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e706130-5034-4000-b84d-2c325cd8d64b]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:44 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivtYUPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26265653330303938', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265653330303938', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:23:45 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:23:45 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=25.176738739013672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.objects.instance [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'flavor' on Instance uuid cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:23:45 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:23:45 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:23:45 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:23:45 user nova-compute[73079]:   <serial>59da9b80-7435-48b2-846c-2bdfa260bc54</serial>
Aug 17 15:23:45 user nova-compute[73079]: </disk>
Aug 17 15:23:45 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:23:45 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:23:46 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:23:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:23:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:23:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] No VIF found with MAC fa:16:3e:7b:e0:8e, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:23:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-db20aded-84cb-47f7-9f0e-7d099cd7a97a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.085s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG nova.compute.manager [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing instance network info cache due to event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updated VIF entry in instance network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG nova.network.neutron [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:23:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4f748327-201d-41aa-b7cf-5ece3d531e3a req-fd88a686-7186-4e64-9d57-fee8fbe2325c service nova] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG nova.compute.manager [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing instance network info cache due to event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updated VIF entry in instance network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG nova.network.neutron [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2ad2fade-b10c-4e51-a317-5190a6e580d0 req-67419d6b-ed83-4340-b9b7-03ae9fb952f7 service nova] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:51 user nova-compute[73079]: INFO nova.compute.manager [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Rebooting instance
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:23:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:23:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:23:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:23:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-6dd2d24c-95aa-416c-a31e-7cc49e89f205 req-37fc63d1-0312-4d9f-8636-ec60f32757f3 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-unplugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6dd2d24c-95aa-416c-a31e-7cc49e89f205 req-37fc63d1-0312-4d9f-8636-ec60f32757f3 service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6dd2d24c-95aa-416c-a31e-7cc49e89f205 req-37fc63d1-0312-4d9f-8636-ec60f32757f3 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6dd2d24c-95aa-416c-a31e-7cc49e89f205 req-37fc63d1-0312-4d9f-8636-ec60f32757f3 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-6dd2d24c-95aa-416c-a31e-7cc49e89f205 req-37fc63d1-0312-4d9f-8636-ec60f32757f3 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-unplugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:54 user nova-compute[73079]: WARNING nova.compute.manager [req-6dd2d24c-95aa-416c-a31e-7cc49e89f205 req-37fc63d1-0312-4d9f-8636-ec60f32757f3 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-unplugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state active and task_state reboot_started.
Aug 17 15:23:55 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance shutdown successfully.
Aug 17 15:23:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-4ee0813c-c0e2-4159-94c6-a1bbd0dc7f7d req-4cc385fd-257b-4224-85c9-8e526a410b51 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4ee0813c-c0e2-4159-94c6-a1bbd0dc7f7d req-4cc385fd-257b-4224-85c9-8e526a410b51 service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4ee0813c-c0e2-4159-94c6-a1bbd0dc7f7d req-4cc385fd-257b-4224-85c9-8e526a410b51 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-4ee0813c-c0e2-4159-94c6-a1bbd0dc7f7d req-4cc385fd-257b-4224-85c9-8e526a410b51 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-4ee0813c-c0e2-4159-94c6-a1bbd0dc7f7d req-4cc385fd-257b-4224-85c9-8e526a410b51 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:56 user nova-compute[73079]: WARNING nova.compute.manager [req-4ee0813c-c0e2-4159-94c6-a1bbd0dc7f7d req-4cc385fd-257b-4224-85c9-8e526a410b51 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state active and task_state reboot_started.
Aug 17 15:23:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for cd6a0642-1876-4a0c-9bd1-0c25e5789666 due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285838.7309864, cd6a0642-1876-4a0c-9bd1-0c25e5789666 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:23:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] VM Resumed (Lifecycle Event)
Aug 17 15:23:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance running successfully.
Aug 17 15:23:58 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance soft rebooted successfully.
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:58 user nova-compute[73079]: WARNING nova.compute.manager [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state active and task_state reboot_started.
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:23:58 user nova-compute[73079]: WARNING nova.compute.manager [req-68a57592-e829-4806-a42f-509918117c17 req-df442fd7-6d6a-4e6b-8d5d-f7611830910d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state active and task_state reboot_started.
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:23:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285838.7346754, cd6a0642-1876-4a0c-9bd1-0c25e5789666 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:23:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] VM Started (Lifecycle Event)
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-90b03151-7b83-4ad5-b84d-cd28c7665b8a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.059s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:23:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:24:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:24:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:24:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:24:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:24:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:40 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:24:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:24:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:24:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:24:47 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:24:47 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.17477798461914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:24:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:24:53 user nova-compute[73079]: INFO nova.compute.manager [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Unrescuing
Aug 17 15:24:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:24:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:24:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:24:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'flavor' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-b0b6362a-1c0b-4184-a3b0-60549aa408da req-6564e442-ca51-4376-9fb8-091be91e0de0 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b0b6362a-1c0b-4184-a3b0-60549aa408da req-6564e442-ca51-4376-9fb8-091be91e0de0 service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b0b6362a-1c0b-4184-a3b0-60549aa408da req-6564e442-ca51-4376-9fb8-091be91e0de0 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-b0b6362a-1c0b-4184-a3b0-60549aa408da req-6564e442-ca51-4376-9fb8-091be91e0de0 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-b0b6362a-1c0b-4184-a3b0-60549aa408da req-6564e442-ca51-4376-9fb8-091be91e0de0 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:54 user nova-compute[73079]: WARNING nova.compute.manager [req-b0b6362a-1c0b-4184-a3b0-60549aa408da req-6564e442-ca51-4376-9fb8-091be91e0de0 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance destroyed successfully.
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:56 user nova-compute[73079]: WARNING nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:56 user nova-compute[73079]: WARNING nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:56 user nova-compute[73079]: WARNING nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:56 user nova-compute[73079]: WARNING nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:56 user nova-compute[73079]: WARNING nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:56 user nova-compute[73079]: WARNING nova.compute.manager [req-56061cee-ef9e-41ac-8d94-31e7b1dc8ed9 req-0e24b50f-1d2f-4ac1-9e99-1e2c81425ddb service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:24:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285898.0760305, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:24:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Resumed (Lifecycle Event)
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-12d7e20b-2a20-4ab6-87c7-d9ccbcbe30de tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:24:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692285898.0783112, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:24:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Started (Lifecycle Event)
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-6318b825-0ceb-4487-a2d4-41826716ef6a req-bc773480-7f61-41fd-a7ca-70b1934698c3 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6318b825-0ceb-4487-a2d4-41826716ef6a req-bc773480-7f61-41fd-a7ca-70b1934698c3 service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6318b825-0ceb-4487-a2d4-41826716ef6a req-bc773480-7f61-41fd-a7ca-70b1934698c3 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6318b825-0ceb-4487-a2d4-41826716ef6a req-bc773480-7f61-41fd-a7ca-70b1934698c3 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:24:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-6318b825-0ceb-4487-a2d4-41826716ef6a req-bc773480-7f61-41fd-a7ca-70b1934698c3 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:24:58 user nova-compute[73079]: WARNING nova.compute.manager [req-6318b825-0ceb-4487-a2d4-41826716ef6a req-bc773480-7f61-41fd-a7ca-70b1934698c3 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state active and task_state None.
Aug 17 15:24:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:25:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:25:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing instance network info cache due to event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:25:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updated VIF entry in instance network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.network.neutron [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-671068f6-27a5-4980-8f5d-931b27d5d967 req-2c636b28-4388-4de2-95c6-f060fc1d9e2d service nova] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:25:44 user nova-compute[73079]: INFO nova.compute.manager [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Detaching volume 59da9b80-7435-48b2-846c-2bdfa260bc54
Aug 17 15:25:44 user nova-compute[73079]: INFO nova.virt.block_device [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Attempting to driver detach volume 59da9b80-7435-48b2-846c-2bdfa260bc54 from mountpoint /dev/vdb
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Attempting to detach device vdb from instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:25:44 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:25:44 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:25:44 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:25:44 user nova-compute[73079]:   <serial>59da9b80-7435-48b2-846c-2bdfa260bc54</serial>
Aug 17 15:25:44 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:25:44 user nova-compute[73079]: </disk>
Aug 17 15:25:44 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:25:44 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully detached device vdb from instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 from the persistent domain config.
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:25:44 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:25:44 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:25:44 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:25:44 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:25:44 user nova-compute[73079]:   <serial>59da9b80-7435-48b2-846c-2bdfa260bc54</serial>
Aug 17 15:25:44 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:25:44 user nova-compute[73079]: </disk>
Aug 17 15:25:44 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692285945.2499957, cd6a0642-1876-4a0c-9bd1-0c25e5789666 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:25:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully detached device vdb from instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 from the live domain config.
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivtYUPpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:25:45 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa3e8b-c607-4858-8aa9-99a6cf26c814]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c921fe-e67b-4bbd-96c3-6644825e272c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 (non-flash)
Aug 17 15:25:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 (non-flash)
Aug 17 15:25:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82ffa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[63deabe0-c746-4582-8640-6734208ac2ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cace371-8e91-4e39-8006-b911ad0d58f2]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf340609-95b2-4c34-ad82-42882319fd38]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d9354-769f-4b2b-9590-a7dfb74df1e2]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[96914d74-fb22-4a36-8836-f835c2863c2a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc26de83-bed2-40bf-8006-36fbc686c895]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260]
Aug 17 15:25:45 user nova-compute[73079]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54, portal: 172.16.0.220,3260] successful.
Aug 17 15:25:45 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59da9b80-7435-48b2-846c-2bdfa260bc54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e2f26-b5ef-4e28-8201-31d81511ae63]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] <== disconnect_volume: return (257ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing instance network info cache due to event network-changed-6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] Acquiring lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] Acquired lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:25:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Refreshing network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:25:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'flavor' on Instance uuid cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:25:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a9b59893-a8df-4bec-a06c-6ec73f61c055 tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:25:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updated VIF entry in instance network info cache for port 6ad8e9ef-03be-47ad-9914-a66bc86321d8. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:25:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [{"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:25:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-addaadee-b737-46c9-96bb-f32ad38c035c req-3b616c88-c086-4177-8c0b-56d790368a13 service nova] Releasing lock "refresh_cache-cd6a0642-1876-4a0c-9bd1-0c25e5789666" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:25:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:25:49 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:25:49 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=25.173259735107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance cd6a0642-1876-4a0c-9bd1-0c25e5789666 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:25:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:25:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:25:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:26:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:26:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:26:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:26:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:26:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:26:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:35 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:26:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:41 user nova-compute[73079]: INFO nova.compute.manager [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Terminating instance
Aug 17 15:26:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-e053847f-cb1e-43f5-a074-a08e3db3c82a req-e98d945b-9e08-430a-b5c6-62f75f43574b service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-unplugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e053847f-cb1e-43f5-a074-a08e3db3c82a req-e98d945b-9e08-430a-b5c6-62f75f43574b service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e053847f-cb1e-43f5-a074-a08e3db3c82a req-e98d945b-9e08-430a-b5c6-62f75f43574b service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e053847f-cb1e-43f5-a074-a08e3db3c82a req-e98d945b-9e08-430a-b5c6-62f75f43574b service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-e053847f-cb1e-43f5-a074-a08e3db3c82a req-e98d945b-9e08-430a-b5c6-62f75f43574b service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-unplugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:26:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-e053847f-cb1e-43f5-a074-a08e3db3c82a req-e98d945b-9e08-430a-b5c6-62f75f43574b service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-unplugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Instance destroyed successfully.
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lazy-loading 'resources' on Instance uuid cd6a0642-1876-4a0c-9bd1-0c25e5789666 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1587545535',display_name='tempest-TestMinimumBasicScenario-server-1587545535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1587545535',id=49,image_ref='7efe0cf2-3d56-433c-ab94-2ad273eb5c33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMgJhh14xAiIJi1PFHI2q9FM5qkqmrqT79mzWvu+0VodmeJAwSbZFtV+8qkzJLPphx8Tf6iocrUTc1JdLLDsbE+lLzusnVceSFXPe52WFg/eOu1eOskgcWL1L7/Iep68Q==',key_name='tempest-TestMinimumBasicScenario-1960169664',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='206af61bece947499bacc93c93f73da7',ramdisk_id='',reservation_id='r-ulp0rpsi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7efe0cf2-3d56-433c-ab94-2ad273eb5c33',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-104665342',owner_user_name='tempest-TestMinimumBasicScenario-104665342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:23:59Z,user_data=None,user_id='392ac56ddb824b94bb1c7743f7241313',uuid=cd6a0642-1876-4a0c-9bd1-0c25e5789666,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converting VIF {"id": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "address": "fa:16:3e:7b:e0:8e", "network": {"id": "3494010e-b1a2-46f4-92f8-a24d9d04fb3d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1822942792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "206af61bece947499bacc93c93f73da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad8e9ef-03", "ovs_interfaceid": "6ad8e9ef-03be-47ad-9914-a66bc86321d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG os_vif [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ad8e9ef-03, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:42 user nova-compute[73079]: INFO os_vif [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:e0:8e,bridge_name='br-int',has_traffic_filtering=True,id=6ad8e9ef-03be-47ad-9914-a66bc86321d8,network=Network(3494010e-b1a2-46f4-92f8-a24d9d04fb3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad8e9ef-03')
Aug 17 15:26:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Deleting instance files /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666_del
Aug 17 15:26:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Deletion of /opt/stack/data/nova/instances/cd6a0642-1876-4a0c-9bd1-0c25e5789666_del complete
Aug 17 15:26:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:26:42 user nova-compute[73079]: INFO nova.compute.manager [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 15:26:42 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:26:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:26:42 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Took 0.59 seconds to deallocate network for instance.
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:26:43 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:26:43 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Deleted allocations for instance cd6a0642-1876-4a0c-9bd1-0c25e5789666
Aug 17 15:26:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-544bde8e-27bc-4126-8600-d6cecd7eef4a tempest-TestMinimumBasicScenario-104665342 tempest-TestMinimumBasicScenario-104665342-project-member] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] Acquiring lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] Lock "cd6a0642-1876-4a0c-9bd1-0c25e5789666-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] No waiting events found dispatching network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:26:44 user nova-compute[73079]: WARNING nova.compute.manager [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received unexpected event network-vif-plugged-6ad8e9ef-03be-47ad-9914-a66bc86321d8 for instance with vm_state deleted and task_state None.
Aug 17 15:26:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-1244138d-1a15-4886-85e6-3a1bbbd4524a req-15163569-fc11-4587-ae6c-dc71ca626bb2 service nova] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Received event network-vif-deleted-6ad8e9ef-03be-47ad-9914-a66bc86321d8 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:26:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:26:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:47 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:48 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:49 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:26:49 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=25.200454711914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:26:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:26:50 user nova-compute[73079]: INFO nova.compute.claims [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Claim successful on node user
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:26:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.policy [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c0c88d3cad6476a87e701a4e49577ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398c723398454ff3b54b35dd61fc59d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:26:50 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Creating image(s)
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk 1073741824" returned: 0 in 0.055s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Successfully created port: c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Cannot resize image /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG nova.objects.instance [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'migration_context' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Ensure instance console log exists: /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Successfully updated port: c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.compute.manager [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing instance network info cache due to event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance network_info: |[{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Start _get_guest_xml network_info=[{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:26:52 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:26:52 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005121242',display_name='tempest-ServerRescueNegativeTestJSON-server-1005121242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005121242',id=50,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5l98Yh0w1l4BPTvGzYO5w8wJ7ccK3sl8IhhziW+5MZ1IhPuZ18wXEoI9erosMu4xWSimr71FujAdVekGDykHzJDJ4Ic4R8eX1iaa6fohGqLwogx0iMYf+YGyWSH6MUSA==',key_name='tempest-keypair-1097913837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-l9ykqig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6cdfde4f-5c56-468b-b269-06a00c6e075c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:26:52 user nova-compute[73079]:   <uuid>6cdfde4f-5c56-468b-b269-06a00c6e075c</uuid>
Aug 17 15:26:52 user nova-compute[73079]:   <name>instance-00000032</name>
Aug 17 15:26:52 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:26:52 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:26:52 user nova-compute[73079]:   <metadata>
Aug 17 15:26:52 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:26:52 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:26:52 user nova-compute[73079]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1005121242</nova:name>
Aug 17 15:26:52 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:26:52</nova:creationTime>
Aug 17 15:26:52 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:26:52 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:26:52 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:26:52 user nova-compute[73079]:       <nova:owner>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:user uuid="0c0c88d3cad6476a87e701a4e49577ac">tempest-ServerRescueNegativeTestJSON-311904791-project-member</nova:user>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:project uuid="398c723398454ff3b54b35dd61fc59d3">tempest-ServerRescueNegativeTestJSON-311904791</nova:project>
Aug 17 15:26:52 user nova-compute[73079]:       </nova:owner>
Aug 17 15:26:52 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:26:52 user nova-compute[73079]:       <nova:ports>
Aug 17 15:26:52 user nova-compute[73079]:         <nova:port uuid="c1465ddd-fc88-4f0a-a417-b20a91d06c89">
Aug 17 15:26:52 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 15:26:52 user nova-compute[73079]:         </nova:port>
Aug 17 15:26:52 user nova-compute[73079]:       </nova:ports>
Aug 17 15:26:52 user nova-compute[73079]:     </nova:instance>
Aug 17 15:26:52 user nova-compute[73079]:   </metadata>
Aug 17 15:26:52 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:26:52 user nova-compute[73079]:     <system>
Aug 17 15:26:52 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:26:52 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:26:52 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:26:52 user nova-compute[73079]:       <entry name="serial">6cdfde4f-5c56-468b-b269-06a00c6e075c</entry>
Aug 17 15:26:52 user nova-compute[73079]:       <entry name="uuid">6cdfde4f-5c56-468b-b269-06a00c6e075c</entry>
Aug 17 15:26:52 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:26:52 user nova-compute[73079]:     </system>
Aug 17 15:26:52 user nova-compute[73079]:   </sysinfo>
Aug 17 15:26:52 user nova-compute[73079]:   <os>
Aug 17 15:26:52 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:26:52 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:26:52 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:26:52 user nova-compute[73079]:   </os>
Aug 17 15:26:52 user nova-compute[73079]:   <features>
Aug 17 15:26:52 user nova-compute[73079]:     <acpi/>
Aug 17 15:26:52 user nova-compute[73079]:     <apic/>
Aug 17 15:26:52 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:26:52 user nova-compute[73079]:   </features>
Aug 17 15:26:52 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:26:52 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:26:52 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:26:52 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:26:52 user nova-compute[73079]:   </clock>
Aug 17 15:26:52 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:26:52 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:26:52 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:26:52 user nova-compute[73079]:   </cpu>
Aug 17 15:26:52 user nova-compute[73079]:   <devices>
Aug 17 15:26:52 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:26:52 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:26:52 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk"/>
Aug 17 15:26:52 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:26:52 user nova-compute[73079]:     </disk>
Aug 17 15:26:52 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:26:52 user nova-compute[73079]:       <mac address="fa:16:3e:07:c8:3b"/>
Aug 17 15:26:52 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:26:52 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:26:52 user nova-compute[73079]:       <target dev="tapc1465ddd-fc"/>
Aug 17 15:26:52 user nova-compute[73079]:     </interface>
Aug 17 15:26:52 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:26:52 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/console.log" append="off"/>
Aug 17 15:26:52 user nova-compute[73079]:     </serial>
Aug 17 15:26:52 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:26:52 user nova-compute[73079]:     <video>
Aug 17 15:26:52 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:26:52 user nova-compute[73079]:     </video>
Aug 17 15:26:52 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:26:52 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:26:52 user nova-compute[73079]:     </rng>
Aug 17 15:26:52 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:26:52 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:26:52 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:26:52 user nova-compute[73079]:     </memballoon>
Aug 17 15:26:52 user nova-compute[73079]:   </devices>
Aug 17 15:26:52 user nova-compute[73079]: </domain>
Aug 17 15:26:52 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005121242',display_name='tempest-ServerRescueNegativeTestJSON-server-1005121242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005121242',id=50,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5l98Yh0w1l4BPTvGzYO5w8wJ7ccK3sl8IhhziW+5MZ1IhPuZ18wXEoI9erosMu4xWSimr71FujAdVekGDykHzJDJ4Ic4R8eX1iaa6fohGqLwogx0iMYf+YGyWSH6MUSA==',key_name='tempest-keypair-1097913837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-l9ykqig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:26:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6cdfde4f-5c56-468b-b269-06a00c6e075c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG os_vif [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1465ddd-fc, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1465ddd-fc, col_values=(('external_ids', {'iface-id': 'c1465ddd-fc88-4f0a-a417-b20a91d06c89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c8:3b', 'vm-uuid': '6cdfde4f-5c56-468b-b269-06a00c6e075c'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:52 user nova-compute[73079]: INFO os_vif [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc')
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:07:c8:3b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updated VIF entry in instance network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:26:52 user nova-compute[73079]: DEBUG nova.network.neutron [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:26:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-59dcfb6c-a4b1-4ac9-aaaa-62340683ae00 req-7e38e149-2572-4f6d-9b62-ffdb72a6b420 service nova] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:26:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-7decb849-c8d9-4fd9-b125-5d7a3198c353 req-2b650128-39ec-45e2-87cb-f06dd65757df service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7decb849-c8d9-4fd9-b125-5d7a3198c353 req-2b650128-39ec-45e2-87cb-f06dd65757df service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7decb849-c8d9-4fd9-b125-5d7a3198c353 req-2b650128-39ec-45e2-87cb-f06dd65757df service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-7decb849-c8d9-4fd9-b125-5d7a3198c353 req-2b650128-39ec-45e2-87cb-f06dd65757df service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-7decb849-c8d9-4fd9-b125-5d7a3198c353 req-2b650128-39ec-45e2-87cb-f06dd65757df service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:26:54 user nova-compute[73079]: WARNING nova.compute.manager [req-7decb849-c8d9-4fd9-b125-5d7a3198c353 req-2b650128-39ec-45e2-87cb-f06dd65757df service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state building and task_state spawning.
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286016.1246283, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Resumed (Lifecycle Event)
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance spawned successfully.
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286016.1263263, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Started (Lifecycle Event)
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:26:56 user nova-compute[73079]: INFO nova.compute.manager [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Took 5.93 seconds to build instance.
Aug 17 15:26:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-40af53ca-470d-423d-ac06-540a774d03a4 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.018s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-e4b040ef-1bc1-4a24-94d5-e05b1fec62fb req-9b9a0ad6-f447-45c6-b0e5-a578f9028e4e service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e4b040ef-1bc1-4a24-94d5-e05b1fec62fb req-9b9a0ad6-f447-45c6-b0e5-a578f9028e4e service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e4b040ef-1bc1-4a24-94d5-e05b1fec62fb req-9b9a0ad6-f447-45c6-b0e5-a578f9028e4e service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e4b040ef-1bc1-4a24-94d5-e05b1fec62fb req-9b9a0ad6-f447-45c6-b0e5-a578f9028e4e service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:26:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-e4b040ef-1bc1-4a24-94d5-e05b1fec62fb req-9b9a0ad6-f447-45c6-b0e5-a578f9028e4e service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:26:56 user nova-compute[73079]: WARNING nova.compute.manager [req-e4b040ef-1bc1-4a24-94d5-e05b1fec62fb req-9b9a0ad6-f447-45c6-b0e5-a578f9028e4e service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state active and task_state None.
Aug 17 15:26:57 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692286002.3053596, cd6a0642-1876-4a0c-9bd1-0c25e5789666 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:26:57 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] VM Stopped (Lifecycle Event)
Aug 17 15:26:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-46480f8f-f81d-474b-897c-1dc96b9cc71e None None] [instance: cd6a0642-1876-4a0c-9bd1-0c25e5789666] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:26:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:26:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:00 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:27:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:28 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:27:28 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:27:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:40 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:42 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:42 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:27:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:27:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:27:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:27:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:27:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Triggering sync for uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "6e2071e1-3534-4ad7-9058-29363700645c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "6e2071e1-3534-4ad7-9058-29363700645c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:51 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:27:51 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=25.20962142944336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6cdfde4f-5c56-468b-b269-06a00c6e075c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:27:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:27:56 user nova-compute[73079]: INFO nova.compute.claims [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Claim successful on node user
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:27:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.policy [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e9ecb2ca70741af92fd76526af06857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a58edf2b2f42d393d1b4f8a150126c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:27:56 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Creating image(s)
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "/opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "/opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "/opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk 1073741824" returned: 0 in 0.050s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Successfully created port: 6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Cannot resize image /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'migration_context' on Instance uuid 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Ensure instance console log exists: /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:27:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Successfully updated port: 6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquired lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-changed-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Refreshing instance network info cache due to event network-changed-6d002f0d-256b-4614-b946-ded7cdb5fe8e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] Acquiring lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.neutron [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Releasing lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Instance network_info: |[{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] Acquired lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.neutron [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Refreshing network info cache for port 6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Start _get_guest_xml network_info=[{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:27:58 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:27:58 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-899128546',display_name='tempest-TestStampPattern-server-899128546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-899128546',id=51,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFXrWBapiEfUe6DfSrg6QOpK8lxSgIUWjtSIiyj8hD+c83tHTVRjOKvErSxn+o+4Eh2DHE9d/2o94IVot70NCIEJymGf8cnMEavoIEJ3jc+a4+a7VNnpJSsYFR8D/MbAw==',key_name='tempest-TestStampPattern-955778153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a58edf2b2f42d393d1b4f8a150126c',ramdisk_id='',reservation_id='r-ksp9sy2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-451604703',owner_user_name='tempest-TestStampPattern-451604703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:27:57Z,user_data=None,user_id='3e9ecb2ca70741af92fd76526af06857',uuid=081bfa8d-f9b2-41d5-a646-600da1f829ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converting VIF {"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.objects.instance [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'pci_devices' on Instance uuid 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:27:58 user nova-compute[73079]:   <uuid>081bfa8d-f9b2-41d5-a646-600da1f829ff</uuid>
Aug 17 15:27:58 user nova-compute[73079]:   <name>instance-00000033</name>
Aug 17 15:27:58 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:27:58 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:27:58 user nova-compute[73079]:   <metadata>
Aug 17 15:27:58 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:27:58 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:27:58 user nova-compute[73079]:       <nova:name>tempest-TestStampPattern-server-899128546</nova:name>
Aug 17 15:27:58 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:27:58</nova:creationTime>
Aug 17 15:27:58 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:27:58 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:27:58 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:27:58 user nova-compute[73079]:       <nova:owner>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:user uuid="3e9ecb2ca70741af92fd76526af06857">tempest-TestStampPattern-451604703-project-member</nova:user>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:project uuid="51a58edf2b2f42d393d1b4f8a150126c">tempest-TestStampPattern-451604703</nova:project>
Aug 17 15:27:58 user nova-compute[73079]:       </nova:owner>
Aug 17 15:27:58 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:27:58 user nova-compute[73079]:       <nova:ports>
Aug 17 15:27:58 user nova-compute[73079]:         <nova:port uuid="6d002f0d-256b-4614-b946-ded7cdb5fe8e">
Aug 17 15:27:58 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 15:27:58 user nova-compute[73079]:         </nova:port>
Aug 17 15:27:58 user nova-compute[73079]:       </nova:ports>
Aug 17 15:27:58 user nova-compute[73079]:     </nova:instance>
Aug 17 15:27:58 user nova-compute[73079]:   </metadata>
Aug 17 15:27:58 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:27:58 user nova-compute[73079]:     <system>
Aug 17 15:27:58 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:27:58 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:27:58 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:27:58 user nova-compute[73079]:       <entry name="serial">081bfa8d-f9b2-41d5-a646-600da1f829ff</entry>
Aug 17 15:27:58 user nova-compute[73079]:       <entry name="uuid">081bfa8d-f9b2-41d5-a646-600da1f829ff</entry>
Aug 17 15:27:58 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:27:58 user nova-compute[73079]:     </system>
Aug 17 15:27:58 user nova-compute[73079]:   </sysinfo>
Aug 17 15:27:58 user nova-compute[73079]:   <os>
Aug 17 15:27:58 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:27:58 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:27:58 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:27:58 user nova-compute[73079]:   </os>
Aug 17 15:27:58 user nova-compute[73079]:   <features>
Aug 17 15:27:58 user nova-compute[73079]:     <acpi/>
Aug 17 15:27:58 user nova-compute[73079]:     <apic/>
Aug 17 15:27:58 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:27:58 user nova-compute[73079]:   </features>
Aug 17 15:27:58 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:27:58 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:27:58 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:27:58 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:27:58 user nova-compute[73079]:   </clock>
Aug 17 15:27:58 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:27:58 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:27:58 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:27:58 user nova-compute[73079]:   </cpu>
Aug 17 15:27:58 user nova-compute[73079]:   <devices>
Aug 17 15:27:58 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:27:58 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:27:58 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk"/>
Aug 17 15:27:58 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:27:58 user nova-compute[73079]:     </disk>
Aug 17 15:27:58 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:27:58 user nova-compute[73079]:       <mac address="fa:16:3e:5b:0a:bd"/>
Aug 17 15:27:58 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:27:58 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:27:58 user nova-compute[73079]:       <target dev="tap6d002f0d-25"/>
Aug 17 15:27:58 user nova-compute[73079]:     </interface>
Aug 17 15:27:58 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:27:58 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/console.log" append="off"/>
Aug 17 15:27:58 user nova-compute[73079]:     </serial>
Aug 17 15:27:58 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:27:58 user nova-compute[73079]:     <video>
Aug 17 15:27:58 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:27:58 user nova-compute[73079]:     </video>
Aug 17 15:27:58 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:27:58 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:27:58 user nova-compute[73079]:     </rng>
Aug 17 15:27:58 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:27:58 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:27:58 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:27:58 user nova-compute[73079]:     </memballoon>
Aug 17 15:27:58 user nova-compute[73079]:   </devices>
Aug 17 15:27:58 user nova-compute[73079]: </domain>
Aug 17 15:27:58 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-899128546',display_name='tempest-TestStampPattern-server-899128546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-899128546',id=51,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFXrWBapiEfUe6DfSrg6QOpK8lxSgIUWjtSIiyj8hD+c83tHTVRjOKvErSxn+o+4Eh2DHE9d/2o94IVot70NCIEJymGf8cnMEavoIEJ3jc+a4+a7VNnpJSsYFR8D/MbAw==',key_name='tempest-TestStampPattern-955778153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a58edf2b2f42d393d1b4f8a150126c',ramdisk_id='',reservation_id='r-ksp9sy2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-451604703',owner_user_name='tempest-TestStampPattern-451604703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:27:57Z,user_data=None,user_id='3e9ecb2ca70741af92fd76526af06857',uuid=081bfa8d-f9b2-41d5-a646-600da1f829ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converting VIF {"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG os_vif [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d002f0d-25, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d002f0d-25, col_values=(('external_ids', {'iface-id': '6d002f0d-256b-4614-b946-ded7cdb5fe8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:0a:bd', 'vm-uuid': '081bfa8d-f9b2-41d5-a646-600da1f829ff'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:27:58 user nova-compute[73079]: INFO os_vif [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25')
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:27:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No VIF found with MAC fa:16:3e:5b:0a:bd, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:27:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updated VIF entry in instance network info cache for port 6d002f0d-256b-4614-b946-ded7cdb5fe8e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:27:59 user nova-compute[73079]: DEBUG nova.network.neutron [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:27:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2b37a287-46a1-408f-84a3-54db3d12b4b2 req-32bf1f92-2fc8-453f-97ea-7bf5495a547e service nova] Releasing lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:27:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-a4b89a2f-3937-40d1-8bf5-a5c0f6178958 req-cb470afc-57f1-41ca-820c-312e93656b7b service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a4b89a2f-3937-40d1-8bf5-a5c0f6178958 req-cb470afc-57f1-41ca-820c-312e93656b7b service nova] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a4b89a2f-3937-40d1-8bf5-a5c0f6178958 req-cb470afc-57f1-41ca-820c-312e93656b7b service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a4b89a2f-3937-40d1-8bf5-a5c0f6178958 req-cb470afc-57f1-41ca-820c-312e93656b7b service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG nova.compute.manager [req-a4b89a2f-3937-40d1-8bf5-a5c0f6178958 req-cb470afc-57f1-41ca-820c-312e93656b7b service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] No waiting events found dispatching network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:28:00 user nova-compute[73079]: WARNING nova.compute.manager [req-a4b89a2f-3937-40d1-8bf5-a5c0f6178958 req-cb470afc-57f1-41ca-820c-312e93656b7b service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received unexpected event network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e for instance with vm_state building and task_state spawning.
Aug 17 15:28:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286082.144951, 081bfa8d-f9b2-41d5-a646-600da1f829ff => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] VM Resumed (Lifecycle Event)
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Instance spawned successfully.
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286082.1493807, 081bfa8d-f9b2-41d5-a646-600da1f829ff => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] VM Started (Lifecycle Event)
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-8a53c83f-b0b4-491d-aafe-2bf68bcd4858 req-b4351400-b366-4042-8e37-e5b1c6db7179 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8a53c83f-b0b4-491d-aafe-2bf68bcd4858 req-b4351400-b366-4042-8e37-e5b1c6db7179 service nova] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8a53c83f-b0b4-491d-aafe-2bf68bcd4858 req-b4351400-b366-4042-8e37-e5b1c6db7179 service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8a53c83f-b0b4-491d-aafe-2bf68bcd4858 req-b4351400-b366-4042-8e37-e5b1c6db7179 service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG nova.compute.manager [req-8a53c83f-b0b4-491d-aafe-2bf68bcd4858 req-b4351400-b366-4042-8e37-e5b1c6db7179 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] No waiting events found dispatching network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:28:02 user nova-compute[73079]: WARNING nova.compute.manager [req-8a53c83f-b0b4-491d-aafe-2bf68bcd4858 req-b4351400-b366-4042-8e37-e5b1c6db7179 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received unexpected event network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e for instance with vm_state building and task_state spawning.
Aug 17 15:28:02 user nova-compute[73079]: INFO nova.compute.manager [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Took 6.06 seconds to build instance.
Aug 17 15:28:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-9daec9cf-7bf4-4f0a-98c0-420eb6bc5a53 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.161s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:28:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG nova.compute.manager [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing instance network info cache due to event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updated VIF entry in instance network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG nova.network.neutron [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:28:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2a3a3958-ac5f-470e-a1d1-7e11e6ca11ec req-f238925b-f9c0-4f68-ad1a-4b47246df5ca service nova] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:28:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:28:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:28:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'flavor' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:28:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:28:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:28:43 user nova-compute[73079]: INFO nova.compute.manager [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Attaching volume 3b986b95-c981-47ae-9aa6-dd9a47fcf91a to /dev/vdb
Aug 17 15:28:43 user nova-compute[73079]: DEBUG os_brick.utils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa3fd8-56f1-4790-a661-e9190d133232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceacbe5-7092-4f89-9c0f-0c43637f4a1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed9740-4965-4bdd-a577-8e3b2c1bc85b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f13e5-e030-42ae-bad0-d4efbee43399]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:28:43 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e7362f-ff74-4373-9eb1-799185a1503b]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG os_brick.utils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating existing volume attachment record: 67d70f52-da47-46e0-909e-a20242346528 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:28:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:28:44 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:28:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:50 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:51 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:52 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:28:52 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=25.17180633544922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6cdfde4f-5c56-468b-b269-06a00c6e075c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:28:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:28:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:53 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:28:53 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:28:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:28:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:28:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWZQjBKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:28:59 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:28:59 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:28:59 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ef0eb-d202-47bf-b9a7-ed69a81190f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:28:59 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9773becf-288f-476b-8b41-e95b1a4a12d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a] added
Aug 17 15:28:59 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[631712ca-98ef-4f46-ad09-aabe2d39c56b]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6227165b-2525-41b9-85cc-af6e333456ec]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWZQjBKx {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWZQjBKx" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9359d9-96a3-44cb-8ebc-c1149eb145b7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWZQjBKx'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd1d64-d89a-4860-8bb3-c942d2ed107f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf3e5ac-d8c7-4a5b-9974-fdd6e43275b4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:28:59 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:28:59 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:28:59 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:28:59 user nova-compute[73079]: 
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbe8f9-6a00-437a-9e82-208bb81045d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260]
Aug 17 15:28:59 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260] successful.
Aug 17 15:28:59 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d37bd78-17e3-436d-86c4-811317b97ba1]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[80284f45-ac96-45dc-905f-5c1a10f1a4de]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:28:59 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:28:59 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe09491-ffba-4900-a978-9aad23cb8781]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:28:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWZQjBKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:29:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:29:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23637383337386638', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:29:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637383337386638', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:29:00 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'flavor' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:29:00 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:29:00 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:29:00 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:29:00 user nova-compute[73079]:   <serial>3b986b95-c981-47ae-9aa6-dd9a47fcf91a</serial>
Aug 17 15:29:00 user nova-compute[73079]: </disk>
Aug 17 15:29:00 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:29:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:29:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:29:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:07:c8:3b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:29:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b1ad622c-7467-4ce2-bb41-89720cda70c6 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.445s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:02 user nova-compute[73079]: INFO nova.compute.manager [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Rescuing
Aug 17 15:29:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:29:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:29:02 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-20b563a0-c100-43dc-afdf-1740fef081eb req-f4e047d5-ca6c-49c8-b24b-d4eb20ca3427 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-20b563a0-c100-43dc-afdf-1740fef081eb req-f4e047d5-ca6c-49c8-b24b-d4eb20ca3427 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-20b563a0-c100-43dc-afdf-1740fef081eb req-f4e047d5-ca6c-49c8-b24b-d4eb20ca3427 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-20b563a0-c100-43dc-afdf-1740fef081eb req-f4e047d5-ca6c-49c8-b24b-d4eb20ca3427 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:03 user nova-compute[73079]: DEBUG nova.compute.manager [req-20b563a0-c100-43dc-afdf-1740fef081eb req-f4e047d5-ca6c-49c8-b24b-d4eb20ca3427 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:29:03 user nova-compute[73079]: WARNING nova.compute.manager [req-20b563a0-c100-43dc-afdf-1740fef081eb req-f4e047d5-ca6c-49c8-b24b-d4eb20ca3427 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state active and task_state rescuing.
Aug 17 15:29:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance destroyed successfully.
Aug 17 15:29:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Attempting rescue
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73079) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance directory exists: not creating {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 15:29:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Creating image(s)
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue" returned: 0 in 0.052s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'migration_context' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Start _get_guest_xml network_info=[{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:07:c8:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'resources' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'numa_topology' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:29:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005121242',display_name='tempest-ServerRescueNegativeTestJSON-server-1005121242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005121242',id=50,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5l98Yh0w1l4BPTvGzYO5w8wJ7ccK3sl8IhhziW+5MZ1IhPuZ18wXEoI9erosMu4xWSimr71FujAdVekGDykHzJDJ4Ic4R8eX1iaa6fohGqLwogx0iMYf+YGyWSH6MUSA==',key_name='tempest-keypair-1097913837',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-l9ykqig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6cdfde4f-5c56-468b-b269-06a00c6e075c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:07:c8:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "vif_mac": "fa:16:3e:07:c8:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:29:04 user nova-compute[73079]:   <uuid>6cdfde4f-5c56-468b-b269-06a00c6e075c</uuid>
Aug 17 15:29:04 user nova-compute[73079]:   <name>instance-00000032</name>
Aug 17 15:29:04 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:29:04 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:29:04 user nova-compute[73079]:   <metadata>
Aug 17 15:29:04 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:29:04 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:29:04 user nova-compute[73079]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1005121242</nova:name>
Aug 17 15:29:04 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:29:04</nova:creationTime>
Aug 17 15:29:04 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:29:04 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:29:04 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:29:04 user nova-compute[73079]:       <nova:owner>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:user uuid="0c0c88d3cad6476a87e701a4e49577ac">tempest-ServerRescueNegativeTestJSON-311904791-project-member</nova:user>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:project uuid="398c723398454ff3b54b35dd61fc59d3">tempest-ServerRescueNegativeTestJSON-311904791</nova:project>
Aug 17 15:29:04 user nova-compute[73079]:       </nova:owner>
Aug 17 15:29:04 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:29:04 user nova-compute[73079]:       <nova:ports>
Aug 17 15:29:04 user nova-compute[73079]:         <nova:port uuid="c1465ddd-fc88-4f0a-a417-b20a91d06c89">
Aug 17 15:29:04 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 15:29:04 user nova-compute[73079]:         </nova:port>
Aug 17 15:29:04 user nova-compute[73079]:       </nova:ports>
Aug 17 15:29:04 user nova-compute[73079]:     </nova:instance>
Aug 17 15:29:04 user nova-compute[73079]:   </metadata>
Aug 17 15:29:04 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:29:04 user nova-compute[73079]:     <system>
Aug 17 15:29:04 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:29:04 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:29:04 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:29:04 user nova-compute[73079]:       <entry name="serial">6cdfde4f-5c56-468b-b269-06a00c6e075c</entry>
Aug 17 15:29:04 user nova-compute[73079]:       <entry name="uuid">6cdfde4f-5c56-468b-b269-06a00c6e075c</entry>
Aug 17 15:29:04 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:29:04 user nova-compute[73079]:     </system>
Aug 17 15:29:04 user nova-compute[73079]:   </sysinfo>
Aug 17 15:29:04 user nova-compute[73079]:   <os>
Aug 17 15:29:04 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:29:04 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:29:04 user nova-compute[73079]:   </os>
Aug 17 15:29:04 user nova-compute[73079]:   <features>
Aug 17 15:29:04 user nova-compute[73079]:     <acpi/>
Aug 17 15:29:04 user nova-compute[73079]:     <apic/>
Aug 17 15:29:04 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:29:04 user nova-compute[73079]:   </features>
Aug 17 15:29:04 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:29:04 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:29:04 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:29:04 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:29:04 user nova-compute[73079]:   </clock>
Aug 17 15:29:04 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:29:04 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:29:04 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:29:04 user nova-compute[73079]:   </cpu>
Aug 17 15:29:04 user nova-compute[73079]:   <devices>
Aug 17 15:29:04 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:29:04 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:29:04 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue"/>
Aug 17 15:29:04 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:29:04 user nova-compute[73079]:     </disk>
Aug 17 15:29:04 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:29:04 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:29:04 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk"/>
Aug 17 15:29:04 user nova-compute[73079]:       <target dev="vdb" bus="virtio"/>
Aug 17 15:29:04 user nova-compute[73079]:     </disk>
Aug 17 15:29:04 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:29:04 user nova-compute[73079]:       <mac address="fa:16:3e:07:c8:3b"/>
Aug 17 15:29:04 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:29:04 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:29:04 user nova-compute[73079]:       <target dev="tapc1465ddd-fc"/>
Aug 17 15:29:04 user nova-compute[73079]:     </interface>
Aug 17 15:29:04 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:29:04 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/console.log" append="off"/>
Aug 17 15:29:04 user nova-compute[73079]:     </serial>
Aug 17 15:29:04 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:29:04 user nova-compute[73079]:     <video>
Aug 17 15:29:04 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:29:04 user nova-compute[73079]:     </video>
Aug 17 15:29:04 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:29:04 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:29:04 user nova-compute[73079]:     </rng>
Aug 17 15:29:04 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:29:04 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:29:04 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:29:04 user nova-compute[73079]:     </memballoon>
Aug 17 15:29:04 user nova-compute[73079]:   </devices>
Aug 17 15:29:04 user nova-compute[73079]: </domain>
Aug 17 15:29:04 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:29:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance destroyed successfully.
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:29:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] No VIF found with MAC fa:16:3e:07:c8:3b, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:29:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-2af43c13-ba58-45e1-9bc1-f1b2298204ca req-edac04ea-bccf-4e24-b3ad-135eb9d20922 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:29:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2af43c13-ba58-45e1-9bc1-f1b2298204ca req-edac04ea-bccf-4e24-b3ad-135eb9d20922 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2af43c13-ba58-45e1-9bc1-f1b2298204ca req-edac04ea-bccf-4e24-b3ad-135eb9d20922 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2af43c13-ba58-45e1-9bc1-f1b2298204ca req-edac04ea-bccf-4e24-b3ad-135eb9d20922 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-2af43c13-ba58-45e1-9bc1-f1b2298204ca req-edac04ea-bccf-4e24-b3ad-135eb9d20922 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:29:05 user nova-compute[73079]: WARNING nova.compute.manager [req-2af43c13-ba58-45e1-9bc1-f1b2298204ca req-edac04ea-bccf-4e24-b3ad-135eb9d20922 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state active and task_state rescuing.
Aug 17 15:29:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:29:08 user nova-compute[73079]: WARNING nova.compute.manager [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state active and task_state rescuing.
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:29:08 user nova-compute[73079]: WARNING nova.compute.manager [req-909847df-7dfa-4928-b869-58102300ea19 req-c01b52a5-fe6d-4128-bcaa-db4c856b0e19 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state active and task_state rescuing.
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 6cdfde4f-5c56-468b-b269-06a00c6e075c due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286148.4211318, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:29:08 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Resumed (Lifecycle Event)
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a5aa3283-d34a-4036-9fda-7f1fa81f4f8f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:29:08 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286148.4229145, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:29:08 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Started (Lifecycle Event)
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:29:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:45 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:29:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-changed-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:29:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Refreshing instance network info cache due to event network-changed-6d002f0d-256b-4614-b946-ded7cdb5fe8e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:29:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] Acquiring lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:29:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] Acquired lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:29:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Refreshing network info cache for port 6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:29:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updated VIF entry in instance network info cache for port 6d002f0d-256b-4614-b946-ded7cdb5fe8e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:29:48 user nova-compute[73079]: DEBUG nova.network.neutron [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:29:48 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-31e802d3-2174-4c69-aa06-ffdbee309a12 req-80f1a090-12dd-484d-9a2d-92abb053c3e3 service nova] Releasing lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:29:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'flavor' on Instance uuid 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:49 user nova-compute[73079]: INFO nova.compute.manager [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Attaching volume 9f74881b-436d-40a0-85dd-c2408823d0ac to /dev/vdb
Aug 17 15:29:49 user nova-compute[73079]: DEBUG os_brick.utils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5310a12b-69a0-40da-841c-6ade12369b79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6075a6e0-5c9e-47c9-a3f7-8e8ba427ed03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1fa3d-840d-431b-b1a4-34fcadf986f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed135b3-bb15-44ef-aa22-7b77cd1449db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:29:49 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:29:49 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a5884-ca4e-44e9-85aa-15d3d7979839]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG os_brick.utils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:29:49 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating existing volume attachment record: caaed9a2-df95-497f-9060-a219982e3201 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:29:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:29:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:29:54 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:29:54 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8482MB free_disk=25.169769287109375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6cdfde4f-5c56-468b-b269-06a00c6e075c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:29:54 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:29:55 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:29:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:29:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:29:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:29:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:29:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwSfbAPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:30:00 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:30:00 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:30:00 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b61bf-eb56-4d0a-bb15-c0da7c783ce3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:30:00 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbdbb2f-4303-4853-b040-de3ec44c4794]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac] added
Aug 17 15:30:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[61623b0e-7527-4867-b106-b4ed7326cc3e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[01005492-516a-45a5-b6cc-baba74b303c0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwSfbAPD {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwSfbAPD" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a9cb5-114f-42af-a44d-262bf9747314]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwSfbAPD'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[549fde27-ec64-459b-8e93-50efac3acf4d]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab3340-0b4b-4aaa-9b02-ccafe4036d8b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:30:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:30:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4192a95d-e591-4a2c-aa94-64708110774a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260]
Aug 17 15:30:00 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260] successful.
Aug 17 15:30:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[815dd072-2616-4c67-9df6-878ef0e3fcf6]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86270ff-1276-4abc-8fb8-807cb65a7f0d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:30:00 user nova-compute[73079]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac (non-flash)
Aug 17 15:30:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:30:00 user nova-compute[73079]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac (non-flash)
Aug 17 15:30:00 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa8a0b9-72b0-49c0-bc5a-6c80c3812069]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:30:00 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwSfbAPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26232323136366337', 'path': '/dev/sdc'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232323136366337', 'path': '/dev/sdc'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG nova.objects.instance [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'flavor' on Instance uuid 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:30:01 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:30:01 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 15:30:01 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:30:01 user nova-compute[73079]:   <serial>9f74881b-436d-40a0-85dd-c2408823d0ac</serial>
Aug 17 15:30:01 user nova-compute[73079]: </disk>
Aug 17 15:30:01 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No VIF found with MAC fa:16:3e:5b:0a:bd, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:30:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afa77862-3c63-427a-b6a3-89ee3f0cbac6 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.139s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:04 user nova-compute[73079]: INFO nova.compute.manager [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Detaching volume 9f74881b-436d-40a0-85dd-c2408823d0ac
Aug 17 15:30:04 user nova-compute[73079]: INFO nova.virt.block_device [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Attempting to driver detach volume 9f74881b-436d-40a0-85dd-c2408823d0ac from mountpoint /dev/vdb
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Attempting to detach device vdb from instance 081bfa8d-f9b2-41d5-a646-600da1f829ff from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:30:04 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:30:04 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 15:30:04 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:30:04 user nova-compute[73079]:   <serial>9f74881b-436d-40a0-85dd-c2408823d0ac</serial>
Aug 17 15:30:04 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:30:04 user nova-compute[73079]: </disk>
Aug 17 15:30:04 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:30:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully detached device vdb from instance 081bfa8d-f9b2-41d5-a646-600da1f829ff from the persistent domain config.
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 081bfa8d-f9b2-41d5-a646-600da1f829ff from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:30:04 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:30:04 user nova-compute[73079]:   <source dev="/dev/sdc"/>
Aug 17 15:30:04 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:30:04 user nova-compute[73079]:   <serial>9f74881b-436d-40a0-85dd-c2408823d0ac</serial>
Aug 17 15:30:04 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:30:04 user nova-compute[73079]: </disk>
Aug 17 15:30:04 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692286204.854653, 081bfa8d-f9b2-41d5-a646-600da1f829ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:30:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully detached device vdb from instance 081bfa8d-f9b2-41d5-a646-600da1f829ff from the live domain config.
Aug 17 15:30:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwSfbAPD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:30:04 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a345be3-fd2e-4a0f-8aac-6980911d960e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf193096-3ee7-4bf4-a0f4-8c2272436379]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:30:04 user nova-compute[73079]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac (non-flash)
Aug 17 15:30:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:30:04 user nova-compute[73079]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac (non-flash)
Aug 17 15:30:04 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27c83dd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac'): ({'sdc'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Removing single pathed devices sdc {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c8fc56-5b0a-4df0-9e05-d3a4f37d1982]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb38bf0-e0ca-40d5-8f4f-be9a12ac8736]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Flushing IO for device /dev/sdc {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ac798-510f-4656-bcdd-00958bb9e268]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:30:04 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccc8879-9d1c-4ffe-95d4-aa3f266c1e78]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] SCSI volumes sdc have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec64b7d-e1a8-435a-ba5f-7a5324c40f94]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbc1199-4e51-45cf-a7f8-8ae585829294]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260]
Aug 17 15:30:05 user nova-compute[73079]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac, portal: 172.16.0.220,3260] successful.
Aug 17 15:30:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f74881b-436d-40a0-85dd-c2408823d0ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[242917e9-435a-4b63-a232-8526c2be5c23]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] <== disconnect_volume: return (256ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'flavor' on Instance uuid 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:30:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-7168d38a-1d22-4e8b-9877-3dc85741b241 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.607s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [{"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-6e2071e1-3534-4ad7-9058-29363700645c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:30:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:30:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:53 user nova-compute[73079]: INFO nova.compute.manager [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Unrescuing
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'flavor' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-c365a2f5-9041-496d-86b4-6313ba2d79ae req-6e5e1745-6dd9-4026-b231-de54d43d40c4 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c365a2f5-9041-496d-86b4-6313ba2d79ae req-6e5e1745-6dd9-4026-b231-de54d43d40c4 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c365a2f5-9041-496d-86b4-6313ba2d79ae req-6e5e1745-6dd9-4026-b231-de54d43d40c4 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-c365a2f5-9041-496d-86b4-6313ba2d79ae req-6e5e1745-6dd9-4026-b231-de54d43d40c4 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:54 user nova-compute[73079]: DEBUG nova.compute.manager [req-c365a2f5-9041-496d-86b4-6313ba2d79ae req-6e5e1745-6dd9-4026-b231-de54d43d40c4 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:30:54 user nova-compute[73079]: WARNING nova.compute.manager [req-c365a2f5-9041-496d-86b4-6313ba2d79ae req-6e5e1745-6dd9-4026-b231-de54d43d40c4 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:30:54 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance destroyed successfully.
Aug 17 15:30:54 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:30:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8571MB free_disk=25.168773651123047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6cdfde4f-5c56-468b-b269-06a00c6e075c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:30:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:30:56 user nova-compute[73079]: WARNING nova.compute.manager [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:30:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:56 user nova-compute[73079]: DEBUG nova.compute.manager [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:30:56 user nova-compute[73079]: WARNING nova.compute.manager [req-3a2e7311-ef67-4fb2-ac72-b50f5b703a5f req-deb49681-6c0a-4ad8-8753-ee2c9c3b9cb0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state rescued and task_state unrescuing.
Aug 17 15:30:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Removed pending event for 6cdfde4f-5c56-468b-b269-06a00c6e075c due to event {{(pid=73079) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286258.5723057, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:30:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Resumed (Lifecycle Event)
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-35d88e58-e6a8-4bae-8e24-d2d512b576ac tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:30:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286258.5733812, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:30:58 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Started (Lifecycle Event)
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-df410ee8-6559-42df-91c7-223d903ebac9 req-87d6b7d5-cd44-488e-9033-36bb5bb8b7a0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df410ee8-6559-42df-91c7-223d903ebac9 req-87d6b7d5-cd44-488e-9033-36bb5bb8b7a0 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df410ee8-6559-42df-91c7-223d903ebac9 req-87d6b7d5-cd44-488e-9033-36bb5bb8b7a0 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-df410ee8-6559-42df-91c7-223d903ebac9 req-87d6b7d5-cd44-488e-9033-36bb5bb8b7a0 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:30:58 user nova-compute[73079]: DEBUG nova.compute.manager [req-df410ee8-6559-42df-91c7-223d903ebac9 req-87d6b7d5-cd44-488e-9033-36bb5bb8b7a0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:30:58 user nova-compute[73079]: WARNING nova.compute.manager [req-df410ee8-6559-42df-91c7-223d903ebac9 req-87d6b7d5-cd44-488e-9033-36bb5bb8b7a0 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state active and task_state None.
Aug 17 15:30:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:04 user nova-compute[73079]: DEBUG nova.compute.manager [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:31:04 user nova-compute[73079]: INFO nova.compute.manager [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] instance snapshotting
Aug 17 15:31:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Beginning live snapshot process
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json -f qcow2 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjr9zh3yi/745c2e56b99c414296fb7c6ff284d867.delta 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjr9zh3yi/745c2e56b99c414296fb7c6ff284d867.delta 1073741824" returned: 0 in 0.054s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 15:31:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 15:31:06 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73079) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 15:31:06 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 15:31:07 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 15:31:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjr9zh3yi/745c2e56b99c414296fb7c6ff284d867.delta /opt/stack/data/nova/instances/snapshots/tmpjr9zh3yi/745c2e56b99c414296fb7c6ff284d867 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjr9zh3yi/745c2e56b99c414296fb7c6ff284d867.delta /opt/stack/data/nova/instances/snapshots/tmpjr9zh3yi/745c2e56b99c414296fb7c6ff284d867" returned: 0 in 0.732s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:07 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Snapshot extracted, beginning image upload
Aug 17 15:31:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:31:10 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Snapshot image upload complete
Aug 17 15:31:10 user nova-compute[73079]: INFO nova.compute.manager [None req-9293e897-fd62-451b-a94b-8cff8b0e3e24 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Took 5.21 seconds to snapshot the instance on the hypervisor.
Aug 17 15:31:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:12 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:31:13 user nova-compute[73079]: INFO nova.compute.claims [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Claim successful on node user
Aug 17 15:31:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.network.neutron [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:31:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.policy [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e9ecb2ca70741af92fd76526af06857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a58edf2b2f42d393d1b4f8a150126c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:31:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Creating image(s)
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "/opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "/opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "/opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "b6bf435b7f3139e9db66a6550a37b505fd3221f9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "b6bf435b7f3139e9db66a6550a37b505fd3221f9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.part --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG nova.network.neutron [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Successfully created port: e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.part --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG nova.virt.images [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] a1b288f3-da2c-4cd9-a6a3-88b34c4b6319 was qcow2, converting to raw {{(pid=73079) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG nova.privsep.utils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73079) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 15:31:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.part /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.converted {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.part /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.converted" returned: 0 in 0.771s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.converted --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "b6bf435b7f3139e9db66a6550a37b505fd3221f9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.942s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Successfully updated port: e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquired lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-changed-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Refreshing instance network info cache due to event network-changed-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] Acquiring lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "b6bf435b7f3139e9db66a6550a37b505fd3221f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "b6bf435b7f3139e9db66a6550a37b505fd3221f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9 --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9,backing_fmt=raw /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.network.neutron [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updating instance_info_cache with network_info: [{"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9,backing_fmt=raw /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk 1073741824" returned: 0 in 0.056s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "b6bf435b7f3139e9db66a6550a37b505fd3221f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Releasing lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Instance network_info: |[{"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] Acquired lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:31:15 user nova-compute[73079]: DEBUG nova.network.neutron [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Refreshing network info cache for port e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6bf435b7f3139e9db66a6550a37b505fd3221f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'migration_context' on Instance uuid a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Ensure instance console log exists: /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Start _get_guest_xml network_info=[{"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3936bc512897c236556d81bfdd385b89',container_format='bare',created_at=2023-08-17T15:31:05Z,direct_url=<?>,disk_format='qcow2',id=a1b288f3-da2c-4cd9-a6a3-88b34c4b6319,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-108811707',owner='51a58edf2b2f42d393d1b4f8a150126c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T15:31:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'a1b288f3-da2c-4cd9-a6a3-88b34c4b6319'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:31:16 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:31:16 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3936bc512897c236556d81bfdd385b89',container_format='bare',created_at=2023-08-17T15:31:05Z,direct_url=<?>,disk_format='qcow2',id=a1b288f3-da2c-4cd9-a6a3-88b34c4b6319,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-108811707',owner='51a58edf2b2f42d393d1b4f8a150126c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T15:31:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-253751693',display_name='tempest-TestStampPattern-server-253751693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-253751693',id=52,image_ref='a1b288f3-da2c-4cd9-a6a3-88b34c4b6319',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFXrWBapiEfUe6DfSrg6QOpK8lxSgIUWjtSIiyj8hD+c83tHTVRjOKvErSxn+o+4Eh2DHE9d/2o94IVot70NCIEJymGf8cnMEavoIEJ3jc+a4+a7VNnpJSsYFR8D/MbAw==',key_name='tempest-TestStampPattern-955778153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a58edf2b2f42d393d1b4f8a150126c',ramdisk_id='',reservation_id='r-icwpe2vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='081bfa8d-f9b2-41d5-a646-600da1f829ff',image_min_disk='1',image_min_ram='0',image_owner_id='51a58edf2b2f42d393d1b4f8a150126c',image_owner_project_name='tempest-TestStampPattern-451604703',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-451604703-project-member',image_user_id='3e9ecb2ca70741af92fd76526af06857',network_allocated='True',owner_project_name='tempest-TestStampPattern-451604703',owner_user_name='tempest-TestStampPattern-451604703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:31:13Z,user_data=None,user_id='3e9ecb2ca70741af92fd76526af06857',uuid=a537ecc5-4fb5-4808-beaa-dbae111cd474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converting VIF {"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'pci_devices' on Instance uuid a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:31:16 user nova-compute[73079]:   <uuid>a537ecc5-4fb5-4808-beaa-dbae111cd474</uuid>
Aug 17 15:31:16 user nova-compute[73079]:   <name>instance-00000034</name>
Aug 17 15:31:16 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:31:16 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:31:16 user nova-compute[73079]:   <metadata>
Aug 17 15:31:16 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:31:16 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:31:16 user nova-compute[73079]:       <nova:name>tempest-TestStampPattern-server-253751693</nova:name>
Aug 17 15:31:16 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:31:16</nova:creationTime>
Aug 17 15:31:16 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:31:16 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:31:16 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:31:16 user nova-compute[73079]:       <nova:owner>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:user uuid="3e9ecb2ca70741af92fd76526af06857">tempest-TestStampPattern-451604703-project-member</nova:user>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:project uuid="51a58edf2b2f42d393d1b4f8a150126c">tempest-TestStampPattern-451604703</nova:project>
Aug 17 15:31:16 user nova-compute[73079]:       </nova:owner>
Aug 17 15:31:16 user nova-compute[73079]:       <nova:root type="image" uuid="a1b288f3-da2c-4cd9-a6a3-88b34c4b6319"/>
Aug 17 15:31:16 user nova-compute[73079]:       <nova:ports>
Aug 17 15:31:16 user nova-compute[73079]:         <nova:port uuid="e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c">
Aug 17 15:31:16 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 15:31:16 user nova-compute[73079]:         </nova:port>
Aug 17 15:31:16 user nova-compute[73079]:       </nova:ports>
Aug 17 15:31:16 user nova-compute[73079]:     </nova:instance>
Aug 17 15:31:16 user nova-compute[73079]:   </metadata>
Aug 17 15:31:16 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:31:16 user nova-compute[73079]:     <system>
Aug 17 15:31:16 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:31:16 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:31:16 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:31:16 user nova-compute[73079]:       <entry name="serial">a537ecc5-4fb5-4808-beaa-dbae111cd474</entry>
Aug 17 15:31:16 user nova-compute[73079]:       <entry name="uuid">a537ecc5-4fb5-4808-beaa-dbae111cd474</entry>
Aug 17 15:31:16 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:31:16 user nova-compute[73079]:     </system>
Aug 17 15:31:16 user nova-compute[73079]:   </sysinfo>
Aug 17 15:31:16 user nova-compute[73079]:   <os>
Aug 17 15:31:16 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:31:16 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:31:16 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:31:16 user nova-compute[73079]:   </os>
Aug 17 15:31:16 user nova-compute[73079]:   <features>
Aug 17 15:31:16 user nova-compute[73079]:     <acpi/>
Aug 17 15:31:16 user nova-compute[73079]:     <apic/>
Aug 17 15:31:16 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:31:16 user nova-compute[73079]:   </features>
Aug 17 15:31:16 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:31:16 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:31:16 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:31:16 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:31:16 user nova-compute[73079]:   </clock>
Aug 17 15:31:16 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:31:16 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:31:16 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:31:16 user nova-compute[73079]:   </cpu>
Aug 17 15:31:16 user nova-compute[73079]:   <devices>
Aug 17 15:31:16 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:31:16 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:31:16 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk"/>
Aug 17 15:31:16 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:31:16 user nova-compute[73079]:     </disk>
Aug 17 15:31:16 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:31:16 user nova-compute[73079]:       <mac address="fa:16:3e:d0:d6:57"/>
Aug 17 15:31:16 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:31:16 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:31:16 user nova-compute[73079]:       <target dev="tape83d0ab7-f5"/>
Aug 17 15:31:16 user nova-compute[73079]:     </interface>
Aug 17 15:31:16 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:31:16 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/console.log" append="off"/>
Aug 17 15:31:16 user nova-compute[73079]:     </serial>
Aug 17 15:31:16 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:31:16 user nova-compute[73079]:     <video>
Aug 17 15:31:16 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:31:16 user nova-compute[73079]:     </video>
Aug 17 15:31:16 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:31:16 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:31:16 user nova-compute[73079]:     </rng>
Aug 17 15:31:16 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:31:16 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:31:16 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:31:16 user nova-compute[73079]:     </memballoon>
Aug 17 15:31:16 user nova-compute[73079]:   </devices>
Aug 17 15:31:16 user nova-compute[73079]: </domain>
Aug 17 15:31:16 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-253751693',display_name='tempest-TestStampPattern-server-253751693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-253751693',id=52,image_ref='a1b288f3-da2c-4cd9-a6a3-88b34c4b6319',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFXrWBapiEfUe6DfSrg6QOpK8lxSgIUWjtSIiyj8hD+c83tHTVRjOKvErSxn+o+4Eh2DHE9d/2o94IVot70NCIEJymGf8cnMEavoIEJ3jc+a4+a7VNnpJSsYFR8D/MbAw==',key_name='tempest-TestStampPattern-955778153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a58edf2b2f42d393d1b4f8a150126c',ramdisk_id='',reservation_id='r-icwpe2vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='081bfa8d-f9b2-41d5-a646-600da1f829ff',image_min_disk='1',image_min_ram='0',image_owner_id='51a58edf2b2f42d393d1b4f8a150126c',image_owner_project_name='tempest-TestStampPattern-451604703',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-451604703-project-member',image_user_id='3e9ecb2ca70741af92fd76526af06857',network_allocated='True',owner_project_name='tempest-TestStampPattern-451604703',owner_user_name='tempest-TestStampPattern-451604703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:31:13Z,user_data=None,user_id='3e9ecb2ca70741af92fd76526af06857',uuid=a537ecc5-4fb5-4808-beaa-dbae111cd474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converting VIF {"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG os_vif [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape83d0ab7-f5, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape83d0ab7-f5, col_values=(('external_ids', {'iface-id': 'e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:d6:57', 'vm-uuid': 'a537ecc5-4fb5-4808-beaa-dbae111cd474'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:16 user nova-compute[73079]: INFO os_vif [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5')
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No VIF found with MAC fa:16:3e:d0:d6:57, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updated VIF entry in instance network info cache for port e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updating instance_info_cache with network_info: [{"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:31:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-afe2ecc5-adb0-4cd0-8321-e4403e7d08a1 req-1b959c7d-f853-4cb1-bfaa-aa47d82fe827 service nova] Releasing lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-49a6e71e-b80a-451a-93f7-66ab2dcf581e req-590c2a02-3b33-44fb-81dd-898bf9ae0484 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49a6e71e-b80a-451a-93f7-66ab2dcf581e req-590c2a02-3b33-44fb-81dd-898bf9ae0484 service nova] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49a6e71e-b80a-451a-93f7-66ab2dcf581e req-590c2a02-3b33-44fb-81dd-898bf9ae0484 service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-49a6e71e-b80a-451a-93f7-66ab2dcf581e req-590c2a02-3b33-44fb-81dd-898bf9ae0484 service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-49a6e71e-b80a-451a-93f7-66ab2dcf581e req-590c2a02-3b33-44fb-81dd-898bf9ae0484 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] No waiting events found dispatching network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:31:17 user nova-compute[73079]: WARNING nova.compute.manager [req-49a6e71e-b80a-451a-93f7-66ab2dcf581e req-590c2a02-3b33-44fb-81dd-898bf9ae0484 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received unexpected event network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c for instance with vm_state building and task_state spawning.
Aug 17 15:31:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-5befcccf-e1a2-4041-9350-833cab40c6cb req-aea2ba61-d501-4b55-bb5a-ece7d71bdb61 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:31:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5befcccf-e1a2-4041-9350-833cab40c6cb req-aea2ba61-d501-4b55-bb5a-ece7d71bdb61 service nova] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5befcccf-e1a2-4041-9350-833cab40c6cb req-aea2ba61-d501-4b55-bb5a-ece7d71bdb61 service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-5befcccf-e1a2-4041-9350-833cab40c6cb req-aea2ba61-d501-4b55-bb5a-ece7d71bdb61 service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:19 user nova-compute[73079]: DEBUG nova.compute.manager [req-5befcccf-e1a2-4041-9350-833cab40c6cb req-aea2ba61-d501-4b55-bb5a-ece7d71bdb61 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] No waiting events found dispatching network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:31:19 user nova-compute[73079]: WARNING nova.compute.manager [req-5befcccf-e1a2-4041-9350-833cab40c6cb req-aea2ba61-d501-4b55-bb5a-ece7d71bdb61 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received unexpected event network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c for instance with vm_state building and task_state spawning.
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286280.0185726, a537ecc5-4fb5-4808-beaa-dbae111cd474 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] VM Resumed (Lifecycle Event)
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Instance spawned successfully.
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286280.0199804, a537ecc5-4fb5-4808-beaa-dbae111cd474 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] VM Started (Lifecycle Event)
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 17 15:31:20 user nova-compute[73079]: DEBUG nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:31:20 user nova-compute[73079]: INFO nova.compute.manager [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Took 7.53 seconds to build instance.
Aug 17 15:31:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-63e32935-3ec1-421e-bd67-f2a6a8c96d6f tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.639s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:31:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:52 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:31:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:31:55 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8320MB free_disk=25.021957397460938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6cdfde4f-5c56-468b-b269-06a00c6e075c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a537ecc5-4fb5-4808-beaa-dbae111cd474 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:31:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:31:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:32:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:32:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:32:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:32:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:32:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:32:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:10 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:32:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:32:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:32:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:32:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:32:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:32:44 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.compute.manager [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing instance network info cache due to event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.network.neutron [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:32:45 user nova-compute[73079]: INFO nova.compute.manager [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Detaching volume 3b986b95-c981-47ae-9aa6-dd9a47fcf91a
Aug 17 15:32:45 user nova-compute[73079]: INFO nova.virt.block_device [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Attempting to driver detach volume 3b986b95-c981-47ae-9aa6-dd9a47fcf91a from mountpoint /dev/vdb
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Attempting to detach device vdb from instance 6cdfde4f-5c56-468b-b269-06a00c6e075c from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:32:45 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:32:45 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:32:45 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:32:45 user nova-compute[73079]:   <serial>3b986b95-c981-47ae-9aa6-dd9a47fcf91a</serial>
Aug 17 15:32:45 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:32:45 user nova-compute[73079]: </disk>
Aug 17 15:32:45 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:32:45 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully detached device vdb from instance 6cdfde4f-5c56-468b-b269-06a00c6e075c from the persistent domain config.
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6cdfde4f-5c56-468b-b269-06a00c6e075c from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:32:45 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:32:45 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:32:45 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:32:45 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:32:45 user nova-compute[73079]:   <serial>3b986b95-c981-47ae-9aa6-dd9a47fcf91a</serial>
Aug 17 15:32:45 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:32:45 user nova-compute[73079]: </disk>
Aug 17 15:32:45 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updated VIF entry in instance network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.network.neutron [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3df35f8d-9fc3-4885-b8d8-ae1fda07648e req-29e26151-560d-4b99-ae97-bbd93a36da70 service nova] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692286366.3702316, 6cdfde4f-5c56-468b-b269-06a00c6e075c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:32:46 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully detached device vdb from instance 6cdfde4f-5c56-468b-b269-06a00c6e075c from the live domain config.
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWZQjBKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:32:46 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2b275-c7ba-4c5b-a72d-f5a15f46ceb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc61e7e6-5dea-4b92-8c63-924d8046247d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:32:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a (non-flash)
Aug 17 15:32:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82f0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7743f3-2721-4d4d-a372-2b173ed977f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf6e08d-3420-47b0-aebc-695d7f922925]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a83dc0-2bb4-400c-a4bb-122b11b7bd6c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c62d687-56b3-4a7a-bdb1-f3ccef547fca]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d192fd5a-a54b-42e3-9134-652b1d5ab48c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfcb94c-81f5-4aeb-b7df-6f4e0387a48c]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260]
Aug 17 15:32:46 user nova-compute[73079]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a, portal: 172.16.0.220,3260] successful.
Aug 17 15:32:46 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b986b95-c981-47ae-9aa6-dd9a47fcf91a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad2610-3f9f-422a-954f-c185c185cc2a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] <== disconnect_volume: return (281ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:32:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG nova.objects.instance [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'flavor' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-062aba4a-b1fa-4085-8bae-5d73cd06e574 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.653s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG nova.compute.manager [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing instance network info cache due to event network-changed-c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] Acquiring lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] Acquired lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Refreshing network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updated VIF entry in instance network info cache for port c1465ddd-fc88-4f0a-a417-b20a91d06c89. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG nova.network.neutron [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [{"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:32:47 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-adfb9549-7660-48d6-9dcf-1e2b9a903536 req-dba5ca37-9fd0-499e-9382-bdcce22e3214 service nova] Releasing lock "refresh_cache-6cdfde4f-5c56-468b-b269-06a00c6e075c" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:32:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:51 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:32:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:32:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:53 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:54 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:32:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:32:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:32:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8454MB free_disk=25.021060943603516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6cdfde4f-5c56-468b-b269-06a00c6e075c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a537ecc5-4fb5-4808-beaa-dbae111cd474 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:32:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:32:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:01 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-changed-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG nova.compute.manager [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Refreshing instance network info cache due to event network-changed-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] Acquiring lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] Acquired lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG nova.network.neutron [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Refreshing network info cache for port e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG nova.network.neutron [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updated VIF entry in instance network info cache for port e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG nova.network.neutron [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updating instance_info_cache with network_info: [{"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG nova.objects.instance [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'flavor' on Instance uuid a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-be85c533-343e-42ff-9ea3-f1b81ccc8d77 req-dc3ebc68-7cc4-45bd-b40f-419f58a1d7cd service nova] Releasing lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:33:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:06 user nova-compute[73079]: INFO nova.compute.manager [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Attaching volume 4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 to /dev/vdb
Aug 17 15:33:06 user nova-compute[73079]: DEBUG os_brick.utils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc59b4-84f1-4737-a1d5-e6915c665ef1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e494bc29-5a1d-45f0-a4ac-b20bb832bb2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca8c205-dbc5-46bc-86f6-e597c9ccca58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d75b820-6107-41e5-92c3-73a141270b24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:33:06 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:33:06 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a0a672-4edb-4b4b-a85e-7d14e50e0437]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG os_brick.utils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:33:06 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updating existing volume attachment record: ae11736d-66c9-4c02-a774-1848c89a5bf2 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:33:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFQEivVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:33:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:33:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:33:16 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f266497b-b432-4de3-9712-0f58e8744816]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:33:16 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd376a54-378d-49b4-b431-198db977302d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5] added
Aug 17 15:33:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d2a65-e834-445e-9d30-ace3e31835d9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d0cff-0279-4682-8201-db64967d4ee9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFQEivVt {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LFQEivVt" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac86c646-487e-4280-abfb-586b998ca369]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LFQEivVt'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a98e8-ae78-40ee-8169-10500e7d96d7]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13b928-bc26-4c2a-bffb-9c241e8a21a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:33:16 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:33:16 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:33:16 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:33:16 user nova-compute[73079]: 
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5cba97-4d05-4470-8da5-ee0c2ac09177]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260]
Aug 17 15:33:16 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260] successful.
Aug 17 15:33:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.091s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83ddbf-db49-444e-af40-f42fe04cb049]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f911ac32-9f11-4ffa-aefc-c40c132ffb24]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 (non-flash)
Aug 17 15:33:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 (non-flash)
Aug 17 15:33:16 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d47dc92-c1e6-41fb-888b-5adcfe3bd20d]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:33:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFQEivVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:33:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:33:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23866303637353935', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:33:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866303637353935', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:33:17 user nova-compute[73079]: DEBUG nova.objects.instance [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'flavor' on Instance uuid a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:33:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:33:17 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:33:17 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:33:17 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:33:17 user nova-compute[73079]:   <serial>4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5</serial>
Aug 17 15:33:17 user nova-compute[73079]: </disk>
Aug 17 15:33:17 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:33:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:33:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:33:18 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] No VIF found with MAC fa:16:3e:d0:d6:57, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:33:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-de82e3ee-ef69-4085-9c19-c1bd129b7312 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.146s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:20 user nova-compute[73079]: INFO nova.compute.manager [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Detaching volume 4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5
Aug 17 15:33:20 user nova-compute[73079]: INFO nova.virt.block_device [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Attempting to driver detach volume 4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 from mountpoint /dev/vdb
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Attempting to detach device vdb from instance a537ecc5-4fb5-4808-beaa-dbae111cd474 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:33:20 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:33:20 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:33:20 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:33:20 user nova-compute[73079]:   <serial>4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5</serial>
Aug 17 15:33:20 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:33:20 user nova-compute[73079]: </disk>
Aug 17 15:33:20 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:33:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully detached device vdb from instance a537ecc5-4fb5-4808-beaa-dbae111cd474 from the persistent domain config.
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a537ecc5-4fb5-4808-beaa-dbae111cd474 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:33:20 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:33:20 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:33:20 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:33:20 user nova-compute[73079]:   <serial>4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5</serial>
Aug 17 15:33:20 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:33:20 user nova-compute[73079]: </disk>
Aug 17 15:33:20 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692286400.968821, a537ecc5-4fb5-4808-beaa-dbae111cd474 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:33:20 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully detached device vdb from instance a537ecc5-4fb5-4808-beaa-dbae111cd474 from the live domain config.
Aug 17 15:33:20 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LFQEivVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:33:20 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:33:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:33:20 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f1c219-d3df-4001-9526-ccca431a9297]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ca185b-35e7-4a6c-ab3e-702d531f64cc]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 (non-flash)
Aug 17 15:33:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 (non-flash)
Aug 17 15:33:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82f2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[267af6bd-11fa-4881-a95e-994fd5ea56bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b620da0-f943-4ed7-99ee-0f3c157581c2]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903954d-b862-4077-98ce-be6ba9cf55e4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0651c-9024-4755-9ee7-08b2c4499c20]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39d703f-baa6-49a2-be22-97cc136fe702]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f128b7a7-4ef6-4e13-a2dc-fe8e6a933d61]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260]
Aug 17 15:33:21 user nova-compute[73079]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5, portal: 172.16.0.220,3260] successful.
Aug 17 15:33:21 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cf0063f-0c1c-4729-9dfa-c8c45deaf7e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a61c04-2d39-40e0-ac09-064d92acab98]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] <== disconnect_volume: return (305ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:33:21 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:33:22 user nova-compute[73079]: DEBUG nova.objects.instance [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'flavor' on Instance uuid a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:33:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-8035e2a1-af97-4bf1-93cf-93f6405e0dc1 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:33:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:33:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:33:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:36 user nova-compute[73079]: INFO nova.compute.manager [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Terminating instance
Aug 17 15:33:36 user nova-compute[73079]: DEBUG nova.compute.manager [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:36 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:36 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Instance destroyed successfully.
Aug 17 15:33:36 user nova-compute[73079]: DEBUG nova.objects.instance [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'resources' on Instance uuid 6cdfde4f-5c56-468b-b269-06a00c6e075c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1005121242',display_name='tempest-ServerRescueNegativeTestJSON-server-1005121242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1005121242',id=50,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5l98Yh0w1l4BPTvGzYO5w8wJ7ccK3sl8IhhziW+5MZ1IhPuZ18wXEoI9erosMu4xWSimr71FujAdVekGDykHzJDJ4Ic4R8eX1iaa6fohGqLwogx0iMYf+YGyWSH6MUSA==',key_name='tempest-keypair-1097913837',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-l9ykqig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6cdfde4f-5c56-468b-b269-06a00c6e075c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "address": "fa:16:3e:07:c8:3b", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1465ddd-fc", "ovs_interfaceid": "c1465ddd-fc88-4f0a-a417-b20a91d06c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG os_vif [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1465ddd-fc, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:37 user nova-compute[73079]: INFO os_vif [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:c8:3b,bridge_name='br-int',has_traffic_filtering=True,id=c1465ddd-fc88-4f0a-a417-b20a91d06c89,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1465ddd-fc')
Aug 17 15:33:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Deleting instance files /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c_del
Aug 17 15:33:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Deletion of /opt/stack/data/nova/instances/6cdfde4f-5c56-468b-b269-06a00c6e075c_del complete
Aug 17 15:33:37 user nova-compute[73079]: INFO nova.compute.manager [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 15:33:37 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-2160d36b-8429-4bcd-8099-7bbd2c08579f req-2e1c91fb-25ef-4033-974d-500264c6d080 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2160d36b-8429-4bcd-8099-7bbd2c08579f req-2e1c91fb-25ef-4033-974d-500264c6d080 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2160d36b-8429-4bcd-8099-7bbd2c08579f req-2e1c91fb-25ef-4033-974d-500264c6d080 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-2160d36b-8429-4bcd-8099-7bbd2c08579f req-2e1c91fb-25ef-4033-974d-500264c6d080 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-2160d36b-8429-4bcd-8099-7bbd2c08579f req-2e1c91fb-25ef-4033-974d-500264c6d080 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:33:37 user nova-compute[73079]: DEBUG nova.compute.manager [req-2160d36b-8429-4bcd-8099-7bbd2c08579f req-2e1c91fb-25ef-4033-974d-500264c6d080 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-unplugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:33:38 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:33:38 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Took 0.90 seconds to deallocate network for instance.
Aug 17 15:33:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:38 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:33:38 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:33:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:38 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Deleted allocations for instance 6cdfde4f-5c56-468b-b269-06a00c6e075c
Aug 17 15:33:38 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-bd8c0251-1149-47c7-b28e-1ce4c1fc2bf7 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:33:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] Acquiring lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] Lock "6cdfde4f-5c56-468b-b269-06a00c6e075c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] No waiting events found dispatching network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:33:39 user nova-compute[73079]: WARNING nova.compute.manager [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received unexpected event network-vif-plugged-c1465ddd-fc88-4f0a-a417-b20a91d06c89 for instance with vm_state deleted and task_state None.
Aug 17 15:33:39 user nova-compute[73079]: DEBUG nova.compute.manager [req-ca2f7235-534f-4ce7-ae07-b123a605dc43 req-8ce9710a-13d5-4efa-92e8-15e0b9026c07 service nova] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Received event network-vif-deleted-c1465ddd-fc88-4f0a-a417-b20a91d06c89 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:33:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:45 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [{"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:33:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:33:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:33:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:51 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692286416.9746573, 6cdfde4f-5c56-468b-b269-06a00c6e075c => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:33:51 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] VM Stopped (Lifecycle Event)
Aug 17 15:33:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-db4fa902-dabc-4c5f-a5a8-264c8264acc3 None None] [instance: 6cdfde4f-5c56-468b-b269-06a00c6e075c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:33:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:33:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:33:57 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:33:57 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:33:57 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.047889709472656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:33:57 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 6e2071e1-3534-4ad7-9058-29363700645c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance a537ecc5-4fb5-4808-beaa-dbae111cd474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:33:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-changed-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Refreshing instance network info cache due to event network-changed-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] Acquiring lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] Acquired lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.network.neutron [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Refreshing network info cache for port e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:11 user nova-compute[73079]: INFO nova.compute.manager [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Terminating instance
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.compute.manager [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-e607f4a2-ccae-4606-9bfc-4266b6256069 req-07f71e3a-b097-4525-b2af-fea6b0c45a7e service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-vif-unplugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e607f4a2-ccae-4606-9bfc-4266b6256069 req-07f71e3a-b097-4525-b2af-fea6b0c45a7e service nova] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e607f4a2-ccae-4606-9bfc-4266b6256069 req-07f71e3a-b097-4525-b2af-fea6b0c45a7e service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-e607f4a2-ccae-4606-9bfc-4266b6256069 req-07f71e3a-b097-4525-b2af-fea6b0c45a7e service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-e607f4a2-ccae-4606-9bfc-4266b6256069 req-07f71e3a-b097-4525-b2af-fea6b0c45a7e service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] No waiting events found dispatching network-vif-unplugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.compute.manager [req-e607f4a2-ccae-4606-9bfc-4266b6256069 req-07f71e3a-b097-4525-b2af-fea6b0c45a7e service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-vif-unplugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.network.neutron [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updated VIF entry in instance network info cache for port e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG nova.network.neutron [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updating instance_info_cache with network_info: [{"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:34:11 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-ba63cf1d-172b-4e20-afbc-b33e42922a63 req-8b924dac-9f0e-4ad0-951c-c4ae5a15b15a service nova] Releasing lock "refresh_cache-a537ecc5-4fb5-4808-beaa-dbae111cd474" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:34:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Instance destroyed successfully.
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'resources' on Instance uuid a537ecc5-4fb5-4808-beaa-dbae111cd474 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-253751693',display_name='tempest-TestStampPattern-server-253751693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-253751693',id=52,image_ref='a1b288f3-da2c-4cd9-a6a3-88b34c4b6319',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFXrWBapiEfUe6DfSrg6QOpK8lxSgIUWjtSIiyj8hD+c83tHTVRjOKvErSxn+o+4Eh2DHE9d/2o94IVot70NCIEJymGf8cnMEavoIEJ3jc+a4+a7VNnpJSsYFR8D/MbAw==',key_name='tempest-TestStampPattern-955778153',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51a58edf2b2f42d393d1b4f8a150126c',ramdisk_id='',reservation_id='r-icwpe2vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='081bfa8d-f9b2-41d5-a646-600da1f829ff',image_min_disk='1',image_min_ram='0',image_owner_id='51a58edf2b2f42d393d1b4f8a150126c',image_owner_project_name='tempest-TestStampPattern-451604703',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-451604703-project-member',image_user_id='3e9ecb2ca70741af92fd76526af06857',owner_project_name='tempest-TestStampPattern-451604703',owner_user_name='tempest-TestStampPattern-451604703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:31:20Z,user_data=None,user_id='3e9ecb2ca70741af92fd76526af06857',uuid=a537ecc5-4fb5-4808-beaa-dbae111cd474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converting VIF {"id": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "address": "fa:16:3e:d0:d6:57", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape83d0ab7-f5", "ovs_interfaceid": "e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG os_vif [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape83d0ab7-f5, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:12 user nova-compute[73079]: INFO os_vif [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d6:57,bridge_name='br-int',has_traffic_filtering=True,id=e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape83d0ab7-f5')
Aug 17 15:34:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Deleting instance files /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474_del
Aug 17 15:34:12 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Deletion of /opt/stack/data/nova/instances/a537ecc5-4fb5-4808-beaa-dbae111cd474_del complete
Aug 17 15:34:12 user nova-compute[73079]: INFO nova.compute.manager [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 15:34:12 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:34:12 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Took 0.42 seconds to deallocate network for instance.
Aug 17 15:34:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:34:12 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:12 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Deleted allocations for instance a537ecc5-4fb5-4808-beaa-dbae111cd474
Aug 17 15:34:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c2bf96d4-5e4f-43d7-a96a-8f45d3ab37c7 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:13 user nova-compute[73079]: DEBUG nova.compute.manager [req-f392f989-c906-4642-85c4-e631c429f243 req-51748903-d8d9-44bf-a39a-bfecc686b0c0 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-vif-deleted-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:13 user nova-compute[73079]: DEBUG nova.compute.manager [req-695d4895-b62b-49a0-bc44-77f1f526e0d9 req-f73085c2-5219-420a-8be8-73869e76a645 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received event network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-695d4895-b62b-49a0-bc44-77f1f526e0d9 req-f73085c2-5219-420a-8be8-73869e76a645 service nova] Acquiring lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-695d4895-b62b-49a0-bc44-77f1f526e0d9 req-f73085c2-5219-420a-8be8-73869e76a645 service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-695d4895-b62b-49a0-bc44-77f1f526e0d9 req-f73085c2-5219-420a-8be8-73869e76a645 service nova] Lock "a537ecc5-4fb5-4808-beaa-dbae111cd474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:13 user nova-compute[73079]: DEBUG nova.compute.manager [req-695d4895-b62b-49a0-bc44-77f1f526e0d9 req-f73085c2-5219-420a-8be8-73869e76a645 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] No waiting events found dispatching network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:34:13 user nova-compute[73079]: WARNING nova.compute.manager [req-695d4895-b62b-49a0-bc44-77f1f526e0d9 req-f73085c2-5219-420a-8be8-73869e76a645 service nova] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Received unexpected event network-vif-plugged-e83d0ab7-f513-4bfc-8fe5-3ea860dc9f6c for instance with vm_state deleted and task_state None.
Aug 17 15:34:17 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:22 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692286452.06464, a537ecc5-4fb5-4808-beaa-dbae111cd474 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:34:27 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] VM Stopped (Lifecycle Event)
Aug 17 15:34:27 user nova-compute[73079]: DEBUG nova.compute.manager [None req-58e217da-33dc-4ab4-91c2-91c3a290a122 None None] [instance: a537ecc5-4fb5-4808-beaa-dbae111cd474] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:34:27 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6e2071e1-3534-4ad7-9058-29363700645c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:41 user nova-compute[73079]: INFO nova.compute.manager [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Terminating instance
Aug 17 15:34:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-04d66d58-936b-4dc1-9afb-4113c31b02b3 req-350b5bff-11c1-4f40-a0ef-a7329d70beea service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-unplugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-04d66d58-936b-4dc1-9afb-4113c31b02b3 req-350b5bff-11c1-4f40-a0ef-a7329d70beea service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-04d66d58-936b-4dc1-9afb-4113c31b02b3 req-350b5bff-11c1-4f40-a0ef-a7329d70beea service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-04d66d58-936b-4dc1-9afb-4113c31b02b3 req-350b5bff-11c1-4f40-a0ef-a7329d70beea service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-04d66d58-936b-4dc1-9afb-4113c31b02b3 req-350b5bff-11c1-4f40-a0ef-a7329d70beea service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-unplugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.compute.manager [req-04d66d58-936b-4dc1-9afb-4113c31b02b3 req-350b5bff-11c1-4f40-a0ef-a7329d70beea service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-unplugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Instance destroyed successfully.
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'resources' on Instance uuid 6e2071e1-3534-4ad7-9058-29363700645c {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-676118727',display_name='tempest-ServerRescueNegativeTestJSON-server-676118727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-676118727',id=48,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-xb1ikbtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:20:13Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=6e2071e1-3534-4ad7-9058-29363700645c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "address": "fa:16:3e:12:cd:ef", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf84e0f76-f1", "ovs_interfaceid": "f84e0f76-f117-4e72-9f31-2f3a4314c837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG os_vif [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf84e0f76-f1, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:34:42 user nova-compute[73079]: INFO os_vif [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:cd:ef,bridge_name='br-int',has_traffic_filtering=True,id=f84e0f76-f117-4e72-9f31-2f3a4314c837,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf84e0f76-f1')
Aug 17 15:34:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Deleting instance files /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c_del
Aug 17 15:34:42 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Deletion of /opt/stack/data/nova/instances/6e2071e1-3534-4ad7-9058-29363700645c_del complete
Aug 17 15:34:42 user nova-compute[73079]: INFO nova.compute.manager [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 15:34:42 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:34:42 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:34:43 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Took 0.44 seconds to deallocate network for instance.
Aug 17 15:34:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-d0897716-c89c-4a9a-9c64-00b55fdeb81e req-ad0cee3b-c115-4eaa-8a4b-b2876cbd2916 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-deleted-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:43 user nova-compute[73079]: INFO nova.compute.manager [req-d0897716-c89c-4a9a-9c64-00b55fdeb81e req-ad0cee3b-c115-4eaa-8a4b-b2876cbd2916 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Neutron deleted interface f84e0f76-f117-4e72-9f31-2f3a4314c837; detaching it from the instance and deleting it from the info cache
Aug 17 15:34:43 user nova-compute[73079]: DEBUG nova.network.neutron [req-d0897716-c89c-4a9a-9c64-00b55fdeb81e req-ad0cee3b-c115-4eaa-8a4b-b2876cbd2916 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG nova.compute.manager [req-d0897716-c89c-4a9a-9c64-00b55fdeb81e req-ad0cee3b-c115-4eaa-8a4b-b2876cbd2916 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Detach interface failed, port_id=f84e0f76-f117-4e72-9f31-2f3a4314c837, reason: Instance 6e2071e1-3534-4ad7-9058-29363700645c could not be found. {{(pid=73079) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:34:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:43 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Deleted allocations for instance 6e2071e1-3534-4ad7-9058-29363700645c
Aug 17 15:34:43 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f18181dd-e48c-4b6f-bbe1-9d971435673f tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "6e2071e1-3534-4ad7-9058-29363700645c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.652s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-40de6722-2faa-489a-9586-8cc13a5fa4ed req-c59af541-032d-4cd0-a704-e625cda426c2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:34:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-40de6722-2faa-489a-9586-8cc13a5fa4ed req-c59af541-032d-4cd0-a704-e625cda426c2 service nova] Acquiring lock "6e2071e1-3534-4ad7-9058-29363700645c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-40de6722-2faa-489a-9586-8cc13a5fa4ed req-c59af541-032d-4cd0-a704-e625cda426c2 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:44 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-40de6722-2faa-489a-9586-8cc13a5fa4ed req-c59af541-032d-4cd0-a704-e625cda426c2 service nova] Lock "6e2071e1-3534-4ad7-9058-29363700645c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:44 user nova-compute[73079]: DEBUG nova.compute.manager [req-40de6722-2faa-489a-9586-8cc13a5fa4ed req-c59af541-032d-4cd0-a704-e625cda426c2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] No waiting events found dispatching network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:34:44 user nova-compute[73079]: WARNING nova.compute.manager [req-40de6722-2faa-489a-9586-8cc13a5fa4ed req-c59af541-032d-4cd0-a704-e625cda426c2 service nova] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Received unexpected event network-vif-plugged-f84e0f76-f117-4e72-9f31-2f3a4314c837 for instance with vm_state deleted and task_state None.
Aug 17 15:34:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:34:55 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:34:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:34:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=25.076393127441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance 081bfa8d-f9b2-41d5-a646-600da1f829ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:34:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:34:57 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692286482.5072353, 6e2071e1-3534-4ad7-9058-29363700645c => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:34:57 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] VM Stopped (Lifecycle Event)
Aug 17 15:34:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-376bb39b-d0bf-4ae7-9b2e-88c620d54094 None None] [instance: 6e2071e1-3534-4ad7-9058-29363700645c] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:34:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:34:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:34:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:02 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-changed-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:15 user nova-compute[73079]: DEBUG nova.compute.manager [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Refreshing instance network info cache due to event network-changed-6d002f0d-256b-4614-b946-ded7cdb5fe8e. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:35:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] Acquiring lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:35:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] Acquired lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:35:15 user nova-compute[73079]: DEBUG nova.network.neutron [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Refreshing network info cache for port 6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:16 user nova-compute[73079]: INFO nova.compute.manager [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Terminating instance
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.compute.manager [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-8b531ea0-78e7-4ec3-8483-104950700543 req-38da545b-c481-446d-8761-a87c758202b8 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-vif-unplugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8b531ea0-78e7-4ec3-8483-104950700543 req-38da545b-c481-446d-8761-a87c758202b8 service nova] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8b531ea0-78e7-4ec3-8483-104950700543 req-38da545b-c481-446d-8761-a87c758202b8 service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-8b531ea0-78e7-4ec3-8483-104950700543 req-38da545b-c481-446d-8761-a87c758202b8 service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-8b531ea0-78e7-4ec3-8483-104950700543 req-38da545b-c481-446d-8761-a87c758202b8 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] No waiting events found dispatching network-vif-unplugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-8b531ea0-78e7-4ec3-8483-104950700543 req-38da545b-c481-446d-8761-a87c758202b8 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-vif-unplugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updated VIF entry in instance network info cache for port 6d002f0d-256b-4614-b946-ded7cdb5fe8e. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.network.neutron [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [{"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:35:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Instance destroyed successfully.
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lazy-loading 'resources' on Instance uuid 081bfa8d-f9b2-41d5-a646-600da1f829ff {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-46e6c091-bd4c-4ba0-a755-a17df793b0c5 req-4d11a42b-cd6e-4f64-bfdc-24d23f3ea560 service nova] Releasing lock "refresh_cache-081bfa8d-f9b2-41d5-a646-600da1f829ff" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-899128546',display_name='tempest-TestStampPattern-server-899128546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-899128546',id=51,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFXrWBapiEfUe6DfSrg6QOpK8lxSgIUWjtSIiyj8hD+c83tHTVRjOKvErSxn+o+4Eh2DHE9d/2o94IVot70NCIEJymGf8cnMEavoIEJ3jc+a4+a7VNnpJSsYFR8D/MbAw==',key_name='tempest-TestStampPattern-955778153',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:28:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51a58edf2b2f42d393d1b4f8a150126c',ramdisk_id='',reservation_id='r-ksp9sy2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-451604703',owner_user_name='tempest-TestStampPattern-451604703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:31:10Z,user_data=None,user_id='3e9ecb2ca70741af92fd76526af06857',uuid=081bfa8d-f9b2-41d5-a646-600da1f829ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converting VIF {"id": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "address": "fa:16:3e:5b:0a:bd", "network": {"id": "3b05e45e-29d8-4df1-afe0-cb5990f3c45c", "bridge": "br-int", "label": "tempest-TestStampPattern-506740809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51a58edf2b2f42d393d1b4f8a150126c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d002f0d-25", "ovs_interfaceid": "6d002f0d-256b-4614-b946-ded7cdb5fe8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG os_vif [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d002f0d-25, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:35:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:16 user nova-compute[73079]: INFO os_vif [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:0a:bd,bridge_name='br-int',has_traffic_filtering=True,id=6d002f0d-256b-4614-b946-ded7cdb5fe8e,network=Network(3b05e45e-29d8-4df1-afe0-cb5990f3c45c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d002f0d-25')
Aug 17 15:35:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Deleting instance files /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff_del
Aug 17 15:35:16 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Deletion of /opt/stack/data/nova/instances/081bfa8d-f9b2-41d5-a646-600da1f829ff_del complete
Aug 17 15:35:17 user nova-compute[73079]: INFO nova.compute.manager [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 15:35:17 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:35:17 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Took 0.44 seconds to deallocate network for instance.
Aug 17 15:35:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:17 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Deleted allocations for instance 081bfa8d-f9b2-41d5-a646-600da1f829ff
Aug 17 15:35:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-617bd14a-bafb-46aa-b79d-13d34f374b63 tempest-TestStampPattern-451604703 tempest-TestStampPattern-451604703-project-member] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.581s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-4a1b2350-b6b0-4ad6-a344-197c4fe0d580 req-2555555b-f8fd-467a-85bf-5b11412575eb service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-vif-deleted-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-bd63c6a9-dddc-4081-98bd-c126fd562ac8 req-de8bf0b3-0f01-404c-a4bb-be812da2907c service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received event network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bd63c6a9-dddc-4081-98bd-c126fd562ac8 req-de8bf0b3-0f01-404c-a4bb-be812da2907c service nova] Acquiring lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bd63c6a9-dddc-4081-98bd-c126fd562ac8 req-de8bf0b3-0f01-404c-a4bb-be812da2907c service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-bd63c6a9-dddc-4081-98bd-c126fd562ac8 req-de8bf0b3-0f01-404c-a4bb-be812da2907c service nova] Lock "081bfa8d-f9b2-41d5-a646-600da1f829ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:18 user nova-compute[73079]: DEBUG nova.compute.manager [req-bd63c6a9-dddc-4081-98bd-c126fd562ac8 req-de8bf0b3-0f01-404c-a4bb-be812da2907c service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] No waiting events found dispatching network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:35:18 user nova-compute[73079]: WARNING nova.compute.manager [req-bd63c6a9-dddc-4081-98bd-c126fd562ac8 req-de8bf0b3-0f01-404c-a4bb-be812da2907c service nova] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Received unexpected event network-vif-plugged-6d002f0d-256b-4614-b946-ded7cdb5fe8e for instance with vm_state deleted and task_state None.
Aug 17 15:35:21 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:26 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:31 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692286516.9336145, 081bfa8d-f9b2-41d5-a646-600da1f829ff => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:35:31 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] VM Stopped (Lifecycle Event)
Aug 17 15:35:31 user nova-compute[73079]: DEBUG nova.compute.manager [None req-92c7e2b0-f27e-4493-a92e-37edf8f474c7 None None] [instance: 081bfa8d-f9b2-41d5-a646-600da1f829ff] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:35:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:32 user nova-compute[73079]: INFO nova.compute.manager [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Terminating instance
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.compute.manager [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-66df78bd-d779-4271-9ad4-ed260fdf63d1 req-802dc44a-3ee3-4012-9b0a-dfc3c9b1cd28 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-66df78bd-d779-4271-9ad4-ed260fdf63d1 req-802dc44a-3ee3-4012-9b0a-dfc3c9b1cd28 service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-66df78bd-d779-4271-9ad4-ed260fdf63d1 req-802dc44a-3ee3-4012-9b0a-dfc3c9b1cd28 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-66df78bd-d779-4271-9ad4-ed260fdf63d1 req-802dc44a-3ee3-4012-9b0a-dfc3c9b1cd28 service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-66df78bd-d779-4271-9ad4-ed260fdf63d1 req-802dc44a-3ee3-4012-9b0a-dfc3c9b1cd28 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.compute.manager [req-66df78bd-d779-4271-9ad4-ed260fdf63d1 req-802dc44a-3ee3-4012-9b0a-dfc3c9b1cd28 service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-unplugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:35:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Instance destroyed successfully.
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.objects.instance [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lazy-loading 'resources' on Instance uuid 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1817772398',display_name='tempest-ServerRescueNegativeTestJSON-server-1817772398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1817772398',id=47,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='398c723398454ff3b54b35dd61fc59d3',ramdisk_id='',reservation_id='r-c5nxthc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-311904791',owner_user_name='tempest-ServerRescueNegativeTestJSON-311904791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:24:58Z,user_data=None,user_id='0c0c88d3cad6476a87e701a4e49577ac',uuid=9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converting VIF {"id": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "address": "fa:16:3e:1d:3f:52", "network": {"id": "6d94bf13-786c-46e0-b37f-8318e62b2dad", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1530189395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "398c723398454ff3b54b35dd61fc59d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef0f8b31-4b", "ovs_interfaceid": "ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG os_vif [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef0f8b31-4b, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:32 user nova-compute[73079]: INFO os_vif [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3f:52,bridge_name='br-int',has_traffic_filtering=True,id=ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef,network=Network(6d94bf13-786c-46e0-b37f-8318e62b2dad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef0f8b31-4b')
Aug 17 15:35:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Deleting instance files /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b_del
Aug 17 15:35:32 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Deletion of /opt/stack/data/nova/instances/9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b_del complete
Aug 17 15:35:33 user nova-compute[73079]: INFO nova.compute.manager [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 17 15:35:33 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:35:33 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Took 0.48 seconds to deallocate network for instance.
Aug 17 15:35:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:35:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:33 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Deleted allocations for instance 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b
Aug 17 15:35:33 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-0fff066b-d18f-4cef-810c-e9cf8d3de901 tempest-ServerRescueNegativeTestJSON-311904791 tempest-ServerRescueNegativeTestJSON-311904791-project-member] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] Acquiring lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] Lock "9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] No waiting events found dispatching network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:35:34 user nova-compute[73079]: WARNING nova.compute.manager [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received unexpected event network-vif-plugged-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef for instance with vm_state deleted and task_state None.
Aug 17 15:35:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-9584d147-8e3f-4fb4-808a-ea4cf037016e req-c8133979-f0f7-4a0a-883c-81295221349a service nova] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Received event network-vif-deleted-ef0f8b31-4b3b-49b6-9a5f-1f1b67ace0ef {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:35:37 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:42 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:35:46 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:35:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:47 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692286532.9632165, 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:35:47 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] VM Stopped (Lifecycle Event)
Aug 17 15:35:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-4c22f848-d3e7-4c6a-9e2a-a190783234aa None None] [instance: 9ec2dfa2-11ee-43b6-a4c2-799dddd3a05b] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:35:47 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:35:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:35:56 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.229049682617188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:35:56 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:35:57 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:35:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:35:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:35:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:35:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:35:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:36:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:36:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:36:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:36:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:36:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:36:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:36:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:36:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:36:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:36:58 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:36:58 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.218887329101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:36:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:37:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:37:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:37:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:37:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:37:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:37:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:21 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:21 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:37:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:37:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:37:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:37:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:37:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:37:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:41 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:37:41 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:37:41 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:43 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:46 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:37:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:37:47 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:37:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:37:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:56 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:37:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:37:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:37:59 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:37:59 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=25.217018127441406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:37:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:38:07 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:11 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:16 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Starting instance... {{(pid=73079) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73079) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 15:38:26 user nova-compute[73079]: INFO nova.compute.claims [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Claim successful on node user
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Start building networks asynchronously for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Allocating IP information in the background. {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.network.neutron [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] allocate_for_instance() {{(pid=73079) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 15:38:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Start building block device mappings for instance. {{(pid=73079) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Start spawning the instance on the hypervisor. {{(pid=73079) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Creating instance directory {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 15:38:26 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Creating image(s)
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "/opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "/opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:26 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.policy [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59e7197908c14fa9a1b38dc68d6a9611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e0f2b04a584e81b69d3e9d31281e0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73079) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.188s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk 1073741824 {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98,backing_fmt=raw /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk 1073741824" returned: 0 in 0.059s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "408e1c63fd971bb55b6d7969590ee4f79c1d6d98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/408e1c63fd971bb55b6d7969590ee4f79c1d6d98 --force-share --output=json" returned: 0 in 0.211s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk. size=1073741824 {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.network.neutron [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Successfully created port: 2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.virt.disk.api [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Cannot resize image /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk to a smaller size. {{(pid=73079) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.objects.instance [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'migration_context' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Created local disks {{(pid=73079) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Ensure instance console log exists: /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/console.log {{(pid=73079) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:27 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Successfully updated port: 2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Building network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Instance cache missing network info. {{(pid=73079) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.compute.manager [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-changed-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.compute.manager [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Refreshing instance network info cache due to event network-changed-2a95ac3d-af17-45fe-bd5c-535d6d83d158. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.neutron [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Instance network_info: |[{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73079) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.neutron [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Refreshing network info cache for port 2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Start _get_guest_xml network_info=[{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f1520146-7ad6-41ad-91e3-e68a652af0d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 15:38:29 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:38:29 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CPU controller missing on host. {{(pid=73079) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.host [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CPU controller found on host. {{(pid=73079) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73079) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T14:36:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T14:36:22Z,direct_url=<?>,disk_format='qcow2',id=f1520146-7ad6-41ad-91e3-e68a652af0d4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='219cab4e912e408e9ca1efe05166c3ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T14:36:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Flavor limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Image limits 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Flavor pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Image pref 0:0:0 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Got 1 possible topologies {{(pid=73079) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.hardware [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73079) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-74284325',display_name='tempest-SnapshotDataIntegrityTests-server-74284325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-74284325',id=53,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygjRpASOCabJxR5gXpUbuEofnGaILgeoWFvPNJ5dhYcV4luaueJqFuIQK17txeniBlwDUUaskGtMopbg4Ak3QQWbRwZuqb/LUQB7PtI0AYrl+OS/lLHMu3fPYsCECffQ==',key_name='tempest-keypair-281914772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e0f2b04a584e81b69d3e9d31281e0c',ramdisk_id='',reservation_id='r-pi9rlqxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1002526285',owner_user_name='tempest-SnapshotDataIntegrityTests-1002526285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e7197908c14fa9a1b38dc68d6a9611',uuid=bb94614c-577e-4446-8d5f-b025586f02b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73079) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Converting VIF {"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.objects.instance [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'pci_devices' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 15:38:29 user nova-compute[73079]:   <uuid>bb94614c-577e-4446-8d5f-b025586f02b6</uuid>
Aug 17 15:38:29 user nova-compute[73079]:   <name>instance-00000035</name>
Aug 17 15:38:29 user nova-compute[73079]:   <memory>524288</memory>
Aug 17 15:38:29 user nova-compute[73079]:   <vcpu>1</vcpu>
Aug 17 15:38:29 user nova-compute[73079]:   <metadata>
Aug 17 15:38:29 user nova-compute[73079]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 15:38:29 user nova-compute[73079]:       <nova:package version="0.0.0"/>
Aug 17 15:38:29 user nova-compute[73079]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-74284325</nova:name>
Aug 17 15:38:29 user nova-compute[73079]:       <nova:creationTime>2023-08-17 15:38:29</nova:creationTime>
Aug 17 15:38:29 user nova-compute[73079]:       <nova:flavor name="m1.tiny">
Aug 17 15:38:29 user nova-compute[73079]:         <nova:memory>512</nova:memory>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:disk>1</nova:disk>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:swap>0</nova:swap>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:vcpus>1</nova:vcpus>
Aug 17 15:38:29 user nova-compute[73079]:       </nova:flavor>
Aug 17 15:38:29 user nova-compute[73079]:       <nova:owner>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:user uuid="59e7197908c14fa9a1b38dc68d6a9611">tempest-SnapshotDataIntegrityTests-1002526285-project-member</nova:user>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:project uuid="e6e0f2b04a584e81b69d3e9d31281e0c">tempest-SnapshotDataIntegrityTests-1002526285</nova:project>
Aug 17 15:38:29 user nova-compute[73079]:       </nova:owner>
Aug 17 15:38:29 user nova-compute[73079]:       <nova:root type="image" uuid="f1520146-7ad6-41ad-91e3-e68a652af0d4"/>
Aug 17 15:38:29 user nova-compute[73079]:       <nova:ports>
Aug 17 15:38:29 user nova-compute[73079]:         <nova:port uuid="2a95ac3d-af17-45fe-bd5c-535d6d83d158">
Aug 17 15:38:29 user nova-compute[73079]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 15:38:29 user nova-compute[73079]:         </nova:port>
Aug 17 15:38:29 user nova-compute[73079]:       </nova:ports>
Aug 17 15:38:29 user nova-compute[73079]:     </nova:instance>
Aug 17 15:38:29 user nova-compute[73079]:   </metadata>
Aug 17 15:38:29 user nova-compute[73079]:   <sysinfo type="smbios">
Aug 17 15:38:29 user nova-compute[73079]:     <system>
Aug 17 15:38:29 user nova-compute[73079]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 15:38:29 user nova-compute[73079]:       <entry name="product">OpenStack Nova</entry>
Aug 17 15:38:29 user nova-compute[73079]:       <entry name="version">0.0.0</entry>
Aug 17 15:38:29 user nova-compute[73079]:       <entry name="serial">bb94614c-577e-4446-8d5f-b025586f02b6</entry>
Aug 17 15:38:29 user nova-compute[73079]:       <entry name="uuid">bb94614c-577e-4446-8d5f-b025586f02b6</entry>
Aug 17 15:38:29 user nova-compute[73079]:       <entry name="family">Virtual Machine</entry>
Aug 17 15:38:29 user nova-compute[73079]:     </system>
Aug 17 15:38:29 user nova-compute[73079]:   </sysinfo>
Aug 17 15:38:29 user nova-compute[73079]:   <os>
Aug 17 15:38:29 user nova-compute[73079]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 15:38:29 user nova-compute[73079]:     <boot dev="hd"/>
Aug 17 15:38:29 user nova-compute[73079]:     <smbios mode="sysinfo"/>
Aug 17 15:38:29 user nova-compute[73079]:   </os>
Aug 17 15:38:29 user nova-compute[73079]:   <features>
Aug 17 15:38:29 user nova-compute[73079]:     <acpi/>
Aug 17 15:38:29 user nova-compute[73079]:     <apic/>
Aug 17 15:38:29 user nova-compute[73079]:     <vmcoreinfo/>
Aug 17 15:38:29 user nova-compute[73079]:   </features>
Aug 17 15:38:29 user nova-compute[73079]:   <clock offset="utc">
Aug 17 15:38:29 user nova-compute[73079]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 15:38:29 user nova-compute[73079]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 15:38:29 user nova-compute[73079]:     <timer name="hpet" present="no"/>
Aug 17 15:38:29 user nova-compute[73079]:   </clock>
Aug 17 15:38:29 user nova-compute[73079]:   <cpu mode="custom" match="exact">
Aug 17 15:38:29 user nova-compute[73079]:     <model>Nehalem</model>
Aug 17 15:38:29 user nova-compute[73079]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 15:38:29 user nova-compute[73079]:   </cpu>
Aug 17 15:38:29 user nova-compute[73079]:   <devices>
Aug 17 15:38:29 user nova-compute[73079]:     <disk type="file" device="disk">
Aug 17 15:38:29 user nova-compute[73079]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 15:38:29 user nova-compute[73079]:       <source file="/opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk"/>
Aug 17 15:38:29 user nova-compute[73079]:       <target dev="vda" bus="virtio"/>
Aug 17 15:38:29 user nova-compute[73079]:     </disk>
Aug 17 15:38:29 user nova-compute[73079]:     <interface type="ethernet">
Aug 17 15:38:29 user nova-compute[73079]:       <mac address="fa:16:3e:20:55:1a"/>
Aug 17 15:38:29 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:38:29 user nova-compute[73079]:       <mtu size="1442"/>
Aug 17 15:38:29 user nova-compute[73079]:       <target dev="tap2a95ac3d-af"/>
Aug 17 15:38:29 user nova-compute[73079]:     </interface>
Aug 17 15:38:29 user nova-compute[73079]:     <serial type="pty">
Aug 17 15:38:29 user nova-compute[73079]:       <log file="/opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/console.log" append="off"/>
Aug 17 15:38:29 user nova-compute[73079]:     </serial>
Aug 17 15:38:29 user nova-compute[73079]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 15:38:29 user nova-compute[73079]:     <video>
Aug 17 15:38:29 user nova-compute[73079]:       <model type="virtio"/>
Aug 17 15:38:29 user nova-compute[73079]:     </video>
Aug 17 15:38:29 user nova-compute[73079]:     <rng model="virtio">
Aug 17 15:38:29 user nova-compute[73079]:       <backend model="random">/dev/urandom</backend>
Aug 17 15:38:29 user nova-compute[73079]:     </rng>
Aug 17 15:38:29 user nova-compute[73079]:     <controller type="usb" index="0" model="none"/>
Aug 17 15:38:29 user nova-compute[73079]:     <memballoon model="virtio">
Aug 17 15:38:29 user nova-compute[73079]:       <stats period="10"/>
Aug 17 15:38:29 user nova-compute[73079]:     </memballoon>
Aug 17 15:38:29 user nova-compute[73079]:   </devices>
Aug 17 15:38:29 user nova-compute[73079]: </domain>
Aug 17 15:38:29 user nova-compute[73079]:  {{(pid=73079) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-74284325',display_name='tempest-SnapshotDataIntegrityTests-server-74284325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-74284325',id=53,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygjRpASOCabJxR5gXpUbuEofnGaILgeoWFvPNJ5dhYcV4luaueJqFuIQK17txeniBlwDUUaskGtMopbg4Ak3QQWbRwZuqb/LUQB7PtI0AYrl+OS/lLHMu3fPYsCECffQ==',key_name='tempest-keypair-281914772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6e0f2b04a584e81b69d3e9d31281e0c',ramdisk_id='',reservation_id='r-pi9rlqxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1002526285',owner_user_name='tempest-SnapshotDataIntegrityTests-1002526285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T15:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e7197908c14fa9a1b38dc68d6a9611',uuid=bb94614c-577e-4446-8d5f-b025586f02b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Converting VIF {"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG os_vif [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af') {{(pid=73079) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a95ac3d-af, may_exist=True, interface_attrs={}) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a95ac3d-af, col_values=(('external_ids', {'iface-id': '2a95ac3d-af17-45fe-bd5c-535d6d83d158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:55:1a', 'vm-uuid': 'bb94614c-577e-4446-8d5f-b025586f02b6'}),), if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:29 user nova-compute[73079]: INFO os_vif [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af')
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:38:29 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No VIF found with MAC fa:16:3e:20:55:1a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:38:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated VIF entry in instance network info cache for port 2a95ac3d-af17-45fe-bd5c-535d6d83d158. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:38:30 user nova-compute[73079]: DEBUG nova.network.neutron [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:38:30 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-f39758be-573a-40f2-a562-6306cc570a27 req-577e5fe9-b3cf-4bca-84c8-4633d2d8d348 service nova] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-3ad108f1-3631-437a-b124-3928dbfbbd31 req-0ea71d5c-1804-4d61-befd-76c7160d458a service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3ad108f1-3631-437a-b124-3928dbfbbd31 req-0ea71d5c-1804-4d61-befd-76c7160d458a service nova] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3ad108f1-3631-437a-b124-3928dbfbbd31 req-0ea71d5c-1804-4d61-befd-76c7160d458a service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-3ad108f1-3631-437a-b124-3928dbfbbd31 req-0ea71d5c-1804-4d61-befd-76c7160d458a service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:31 user nova-compute[73079]: DEBUG nova.compute.manager [req-3ad108f1-3631-437a-b124-3928dbfbbd31 req-0ea71d5c-1804-4d61-befd-76c7160d458a service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] No waiting events found dispatching network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:38:31 user nova-compute[73079]: WARNING nova.compute.manager [req-3ad108f1-3631-437a-b124-3928dbfbbd31 req-0ea71d5c-1804-4d61-befd-76c7160d458a service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received unexpected event network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 for instance with vm_state building and task_state spawning.
Aug 17 15:38:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:32 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-6cd9f52c-ef00-45af-8405-06b898724d48 req-468a7ca8-a414-40a8-8f54-c387035ce9cd service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6cd9f52c-ef00-45af-8405-06b898724d48 req-468a7ca8-a414-40a8-8f54-c387035ce9cd service nova] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6cd9f52c-ef00-45af-8405-06b898724d48 req-468a7ca8-a414-40a8-8f54-c387035ce9cd service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-6cd9f52c-ef00-45af-8405-06b898724d48 req-468a7ca8-a414-40a8-8f54-c387035ce9cd service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [req-6cd9f52c-ef00-45af-8405-06b898724d48 req-468a7ca8-a414-40a8-8f54-c387035ce9cd service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] No waiting events found dispatching network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:38:34 user nova-compute[73079]: WARNING nova.compute.manager [req-6cd9f52c-ef00-45af-8405-06b898724d48 req-468a7ca8-a414-40a8-8f54-c387035ce9cd service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received unexpected event network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 for instance with vm_state building and task_state spawning.
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286714.4413853, bb94614c-577e-4446-8d5f-b025586f02b6 => Resumed> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] VM Resumed (Lifecycle Event)
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Instance event wait completed in 0 seconds for  {{(pid=73079) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Guest created on hypervisor {{(pid=73079) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Instance spawned successfully.
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Found default for hw_cdrom_bus of ide {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Found default for hw_disk_bus of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Found default for hw_input_bus of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Found default for hw_pointer_model of None {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Found default for hw_video_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Found default for hw_vif_model of virtio {{(pid=73079) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.virt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Emitting event <LifecycleEvent: 1692286714.4453695, bb94614c-577e-4446-8d5f-b025586f02b6 => Started> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] VM Started (Lifecycle Event)
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73079) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 17 15:38:34 user nova-compute[73079]: DEBUG nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.compute.manager [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 15:38:34 user nova-compute[73079]: INFO nova.compute.manager [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Took 8.30 seconds to build instance.
Aug 17 15:38:34 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-47af89f2-7276-4c43-9c45-98cd8d71f922 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.422s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:38:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:46 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:47 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:38:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:50 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:38:50 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:38:50 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:38:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:53 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:38:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:38:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:38:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:39:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:39:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:39:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=25.17325210571289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:39:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:39:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:39:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:39:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:39:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:39:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:39:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:39:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:39:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:39:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:39:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:39:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:39:51 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:52 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:39:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:58 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:39:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:39:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:01 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:40:02 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.170684814453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:40:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:40:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:40:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:40:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-changed-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:40:17 user nova-compute[73079]: DEBUG nova.compute.manager [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Refreshing instance network info cache due to event network-changed-2a95ac3d-af17-45fe-bd5c-535d6d83d158. {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 15:40:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:40:17 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:40:17 user nova-compute[73079]: DEBUG nova.network.neutron [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Refreshing network info cache for port 2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 15:40:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated VIF entry in instance network info cache for port 2a95ac3d-af17-45fe-bd5c-535d6d83d158. {{(pid=73079) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 15:40:18 user nova-compute[73079]: DEBUG nova.network.neutron [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:40:18 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-851b20f4-d908-4ccf-81bd-9bf160be5744 req-fb7e6894-207c-40c1-b4dc-3db3ec46eefa service nova] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:40:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:40:23 user nova-compute[73079]: INFO nova.compute.manager [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attaching volume d6c4ffdc-4704-474f-8cde-541b51d7cb08 to /dev/vdb
Aug 17 15:40:23 user nova-compute[73079]: DEBUG os_brick.utils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29eb56-fd82-42b7-b357-6e504e3a9867]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db02c3a-6bbd-416a-9796-1d37416f2013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361ee36-ca84-4880-9e4f-939191e684fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d9d64-596b-4466-9b71-1bc6308bb2ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:40:23 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:40:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ad626-ea9f-4bfa-8c1a-0b6c77268208]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG os_brick.utils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:40:23 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating existing volume attachment record: 4e29ff6b-d656-48d6-9a3c-cb42c208ae19 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:40:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:28 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flKhEGWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:40:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:40:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:40:33 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0133f5f-80f7-4faf-9090-92c7c5141160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:40:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb9859-feff-4280-a4f9-15211a88c041]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08] added
Aug 17 15:40:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2ccce-de7c-4752-8ab3-458d4d8dc0bb]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa29938-24a4-4731-a099-95565b125a9c]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flKhEGWq {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flKhEGWq" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d6985c-72ed-4af3-bc6b-de158273cb5e]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'flKhEGWq'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e9d14-4a09-4f28-9eee-852b95c225f5]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[23698085-f5c4-4627-bbaf-d22703616963]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:40:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:40:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:40:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:40:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:40:33 user nova-compute[73079]: 
Aug 17 15:40:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --login" returned: 0 in 0.198s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d635c6e5-58f9-49de-8565-ad90440e1be0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260]
Aug 17 15:40:34 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260] successful.
Aug 17 15:40:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2112f-14bd-44b4-8a93-bacf2514306a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f67894-b123-466d-ae3a-87d557d9375f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 (non-flash)
Aug 17 15:40:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 (non-flash)
Aug 17 15:40:34 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[29935653-96ff-480f-876f-4695c8cc9d76]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:40:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flKhEGWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23737343834656439', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737343834656439', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG nova.objects.instance [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:40:35 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:40:35 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:40:35 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:40:35 user nova-compute[73079]:   <serial>d6c4ffdc-4704-474f-8cde-541b51d7cb08</serial>
Aug 17 15:40:35 user nova-compute[73079]: </disk>
Aug 17 15:40:35 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No VIF found with MAC fa:16:3e:20:55:1a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:40:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-b7166ccf-4675-4994-a52a-7ae083428257 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.041s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:40:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:48 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:48 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:40:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:40:58 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:40:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:40:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:40:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:00 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:02 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73079) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 15:41:03 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:41:03 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=25.169330596923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:41:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:41:04 user nova-compute[73079]: INFO nova.compute.manager [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Detaching volume d6c4ffdc-4704-474f-8cde-541b51d7cb08
Aug 17 15:41:04 user nova-compute[73079]: INFO nova.virt.block_device [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attempting to driver detach volume d6c4ffdc-4704-474f-8cde-541b51d7cb08 from mountpoint /dev/vdb
Aug 17 15:41:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Attempting to detach device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:41:04 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:41:04 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:41:04 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:41:04 user nova-compute[73079]:   <serial>d6c4ffdc-4704-474f-8cde-541b51d7cb08</serial>
Aug 17 15:41:04 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:41:04 user nova-compute[73079]: </disk>
Aug 17 15:41:04 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:41:04 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config.
Aug 17 15:41:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:41:04 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:41:04 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:41:04 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:41:04 user nova-compute[73079]:   <serial>d6c4ffdc-4704-474f-8cde-541b51d7cb08</serial>
Aug 17 15:41:04 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:41:04 user nova-compute[73079]: </disk>
Aug 17 15:41:04 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692286865.323517, bb94614c-577e-4446-8d5f-b025586f02b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:41:05 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config.
Aug 17 15:41:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flKhEGWq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:41:05 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c803df9-8f33-4266-b75b-f33933900cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[6339e33f-2ef5-4400-ad89-d416dc130c5f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 (non-flash)
Aug 17 15:41:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 (non-flash)
Aug 17 15:41:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e81bd990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[671b07e3-eb3a-4629-98ab-38e460a6b9ca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b052332-438f-4181-9b3e-7da9d38c360f]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e01ab-a6cc-4c34-aeb5-d56d2f1a17a2]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f488e9a-a127-4d4c-a6f6-05dfe14a3e8f]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d29a4a-81af-4f3b-b343-f31083cd54cc]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[78861adb-cf94-4d6c-8455-738981786cee]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260]
Aug 17 15:41:05 user nova-compute[73079]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08, portal: 172.16.0.220,3260] successful.
Aug 17 15:41:05 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c4ffdc-4704-474f-8cde-541b51d7cb08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4afecb0-2fd0-4e1f-8347-c4f121765e26]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== disconnect_volume: return (279ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:41:05 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:41:06 user nova-compute[73079]: DEBUG nova.objects.instance [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:41:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-2d651ee7-06ea-46ff-8a34-df7982dfc03b tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:41:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:41:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:41:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:41:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:41:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:41:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:41:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:41:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:41:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:41:58 user nova-compute[73079]: DEBUG nova.objects.instance [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:41:58 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:41:59 user nova-compute[73079]: INFO nova.compute.manager [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attaching volume 083150f5-1834-407d-b7e3-eabaf78d6cba to /dev/vdb
Aug 17 15:41:59 user nova-compute[73079]: DEBUG os_brick.utils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca0c2ea-01c7-42da-97a7-16f7f6a8f120]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648adc5-80a0-4aee-bba1-8ccab5e2cb9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[412db933-530c-41eb-8ded-8ca37cbb81ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae765b-1785-4766-9b09-1e90cdf2a1b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:41:59 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bb1eb2-3eb0-4161-bf7b-753e246d08f8]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG os_brick.utils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating existing volume attachment record: 133f7d7e-dc33-4c67-afab-90e2bb55940e {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:41:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:42:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=25.16851043701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:42:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvYSyEXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:42:09 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:42:09 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:42:09 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84e52f-2002-426e-b07d-bcb2c91574d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:42:09 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2d76d6-abde-4752-875f-20da160bc400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba] added
Aug 17 15:42:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9462be7-e5f0-450a-bf0f-a9e49d37f630]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ba154-5d36-495e-a2fd-e578b2880bec]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvYSyEXT {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvYSyEXT" returned: 0 in 0.023s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f186fb-8f7a-4666-a6bd-03b1c26d0f23]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvYSyEXT'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2057219-292d-47ef-82f3-a958b1914708]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7374a4b-0136-4507-b1af-05551d63a128]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:42:09 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:42:09 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:42:09 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:42:09 user nova-compute[73079]: 
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6134e1-573d-405a-887e-6073d3a1e47e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260]
Aug 17 15:42:09 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260] successful.
Aug 17 15:42:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c0e7b4-96b9-40f0-b827-c0680a7c5409]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e312fc-ef39-4054-8b94-8d76138f3f07]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba (non-flash)
Aug 17 15:42:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba (non-flash)
Aug 17 15:42:09 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4ff39-9fd3-45e6-ad2f-ff86bc7db40b]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvYSyEXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:42:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26132646563303031', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132646563303031', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG nova.objects.instance [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:42:10 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:42:10 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:42:10 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:42:10 user nova-compute[73079]:   <serial>083150f5-1834-407d-b7e3-eabaf78d6cba</serial>
Aug 17 15:42:10 user nova-compute[73079]: </disk>
Aug 17 15:42:10 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No VIF found with MAC fa:16:3e:20:55:1a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:42:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-438baf44-d249-4e7a-95a0-20457dd66904 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.829s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:42:13 user nova-compute[73079]: INFO nova.compute.manager [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Detaching volume 083150f5-1834-407d-b7e3-eabaf78d6cba
Aug 17 15:42:13 user nova-compute[73079]: INFO nova.virt.block_device [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attempting to driver detach volume 083150f5-1834-407d-b7e3-eabaf78d6cba from mountpoint /dev/vdb
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Attempting to detach device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:42:13 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:42:13 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:42:13 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:42:13 user nova-compute[73079]:   <serial>083150f5-1834-407d-b7e3-eabaf78d6cba</serial>
Aug 17 15:42:13 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:42:13 user nova-compute[73079]: </disk>
Aug 17 15:42:13 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:42:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config.
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:42:13 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:42:13 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:42:13 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:42:13 user nova-compute[73079]:   <serial>083150f5-1834-407d-b7e3-eabaf78d6cba</serial>
Aug 17 15:42:13 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:42:13 user nova-compute[73079]: </disk>
Aug 17 15:42:13 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692286933.9818063, bb94614c-577e-4446-8d5f-b025586f02b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:42:13 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config.
Aug 17 15:42:13 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvYSyEXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:42:13 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:42:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:42:13 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8958a13-a8fe-4e1c-92c4-3bd24be53beb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d464a-a3ae-473d-8853-afbb560af37c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba (non-flash)
Aug 17 15:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba (non-flash)
Aug 17 15:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82f2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333c2a6-854a-4f61-82f2-fa7ecc3fe0d9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c93512-d71d-45e1-991a-3243e443e02d]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c842391-2bd2-4c5b-9317-f177942412cf]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbc086f-e3df-4bd7-8583-00b8fc9c08b4]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e43ede-815d-4d79-b1aa-69c1f0ce7f01]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e3362-3ea9-454a-9a60-9966e62f8527]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260]
Aug 17 15:42:14 user nova-compute[73079]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba, portal: 172.16.0.220,3260] successful.
Aug 17 15:42:14 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083150f5-1834-407d-b7e3-eabaf78d6cba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[74825ea9-ca7f-424c-a7bd-f5c14d2ddb65]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.230s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== disconnect_volume: return (232ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:42:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-994fbb9c-32c1-4445-b6e0-0bab34e7fbe8 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:42:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73079) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:42:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:50 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:42:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Cleaning up deleted instances {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] There are 0 instances to clean {{(pid=73079) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 15:42:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:42:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:03 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:43:04 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.16766357421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:43:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:06 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:43:07 user nova-compute[73079]: INFO nova.compute.manager [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attaching volume 4f585920-4cc0-4da5-96fb-1d549bcb8861 to /dev/vdb
Aug 17 15:43:07 user nova-compute[73079]: DEBUG os_brick.utils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad34a06-f11f-4ffe-92f1-02948385c7f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3af225-126a-4d29-8410-9bfd08314d1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a32de0b-c9c3-4882-9828-0b41411dfea2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5e673a-4242-41c7-a81a-e487c3afef21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:43:07 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:43:07 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[521eee7b-ffc3-4da9-92e2-298e4e3e57d1]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG os_brick.utils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:43:07 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating existing volume attachment record: 9f134a1c-8c45-41e3-85e5-65982811db0e {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:43:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:43:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyLnaKRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:43:17 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:43:17 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:43:17 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[49564796-a91a-4e32-8c3b-b6695b0b4f7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:43:17 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[871420f8-8e08-463e-8818-b8e3898df12e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861] added
Aug 17 15:43:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e846b106-0ab8-471f-9c8e-44116f86d790]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[27edebe4-6166-416e-a6f2-287690b212d4]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyLnaKRl {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyLnaKRl" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317d45f-163f-4c2f-b38a-3c737af4b563]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gyLnaKRl'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[41856da9-ca57-449b-a241-04a35cee090a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a2fb14-ab87-4ef0-81b0-bc4a59df58fa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:43:17 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:43:17 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:43:17 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:43:17 user nova-compute[73079]: 
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[859d1aac-4997-4a01-ad12-f5988b711603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260]
Aug 17 15:43:17 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260] successful.
Aug 17 15:43:17 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c78f04a-2b74-487a-a2ce-48de08f456f0]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:17 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9b3b9-8b3c-4957-8db2-ee6862c50a6a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 (non-flash)
Aug 17 15:43:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 (non-flash)
Aug 17 15:43:18 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fb2ceb-ee9f-41c9-bfb0-5a1e7513a147]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:43:18 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyLnaKRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23261343864396238', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261343864396238', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG nova.objects.instance [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:43:19 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:43:19 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:43:19 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:43:19 user nova-compute[73079]:   <serial>4f585920-4cc0-4da5-96fb-1d549bcb8861</serial>
Aug 17 15:43:19 user nova-compute[73079]: </disk>
Aug 17 15:43:19 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No VIF found with MAC fa:16:3e:20:55:1a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-f1b1e884-7e0c-4956-bc2d-c514fbd7bc5c tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.872s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:43:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:43:22 user nova-compute[73079]: INFO nova.compute.manager [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Detaching volume 4f585920-4cc0-4da5-96fb-1d549bcb8861
Aug 17 15:43:22 user nova-compute[73079]: INFO nova.virt.block_device [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attempting to driver detach volume 4f585920-4cc0-4da5-96fb-1d549bcb8861 from mountpoint /dev/vdb
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Attempting to detach device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:43:22 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:43:22 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:43:22 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:43:22 user nova-compute[73079]:   <serial>4f585920-4cc0-4da5-96fb-1d549bcb8861</serial>
Aug 17 15:43:22 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:43:22 user nova-compute[73079]: </disk>
Aug 17 15:43:22 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:43:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config.
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:43:22 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:43:22 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:43:22 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:43:22 user nova-compute[73079]:   <serial>4f585920-4cc0-4da5-96fb-1d549bcb8861</serial>
Aug 17 15:43:22 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:43:22 user nova-compute[73079]: </disk>
Aug 17 15:43:22 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692287002.7564313, bb94614c-577e-4446-8d5f-b025586f02b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:43:22 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config.
Aug 17 15:43:22 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyLnaKRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:43:22 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86ea60-26ba-40e5-89d1-c53912b506f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c727fa6a-87b2-4a90-b889-7380f0bbb1b3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 (non-flash)
Aug 17 15:43:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 (non-flash)
Aug 17 15:43:22 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27f77b0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1534f80-9790-434a-b9c1-939593ee701d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[8871f451-7ca6-4921-9f50-192ce1f3ad55]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32a52a-8fae-47e4-a7c6-eb90c10bbaae]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db2b0e3-5ea8-47ba-8f22-18c5f9ead894]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[55473dab-2a6c-4cde-b40e-444726b0b13f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:22 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5749e64-dcfa-4f7c-98af-f11f72916a54]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260]
Aug 17 15:43:23 user nova-compute[73079]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861, portal: 172.16.0.220,3260] successful.
Aug 17 15:43:23 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f585920-4cc0-4da5-96fb-1d549bcb8861 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[0252a4cf-988f-49a6-8251-5cc7bd87fb98]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== disconnect_volume: return (281ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG nova.objects.instance [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:43:23 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-5d98e4a0-0d04-4eb8-af00-0a8ad6069152 tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.653s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:43:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:43:52 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:43:53 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:43:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:43:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:43:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:43:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:43:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:43:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:44:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:05 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:06 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:44:06 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.158885955810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:44:06 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:44:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:44:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG nova.objects.instance [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:44:16 user nova-compute[73079]: INFO nova.compute.manager [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attaching volume 6dba8d51-757e-482c-8cd9-8253298ffde2 to /dev/vdb
Aug 17 15:44:16 user nova-compute[73079]: DEBUG os_brick.utils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2b26b-d1db-4f90-adbf-de04259839f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6b3aa981ff14\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d724521-faea-48c0-bb38-6ece2e201c19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdb8000-8785-45df-8999-dfcaca2d964e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[449066c1-da4b-40ea-bffa-f2a999963084]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Running cmd (subprocess): nvme version {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] nvme not present on system {{(pid=73079) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 15:44:16 user nova-compute[73079]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 15:44:16 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[be31adb1-4559-41c1-a6a2-65fd5e30e6c9]: (4, '') {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73079) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.lightos [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] LIGHTOS: no hostnqn found. {{(pid=73079) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG os_brick.utils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6b3aa981ff14', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:44:16 user nova-compute[73079]: DEBUG nova.virt.block_device [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating existing volume attachment record: 3f4782db-a08e-4f22-b19b-8fd26510e166 {{(pid=73079) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 15:44:18 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:44:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Calling os-brick to attach iSCSI Volume {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZFkyGBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:44:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:44:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:44:33 user nova-compute[73079]: INFO os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a8b6b6-91c6-4102-a6cb-72081911c5fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 15:44:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a346a015-bd96-42dd-a724-b16cc305a5f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2] added\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2] added
Aug 17 15:44:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c1dd74-4086-4824-b76d-e9b650dd10e9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10dd860-a117-42ba-9fb8-774e36411543]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZFkyGBC {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZFkyGBC" returned: 0 in 0.021s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e502f9-3707-4c13-a5fa-8fa854fe1875]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PZFkyGBC'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[3158658d-2d01-4fca-b438-78723cea4c77]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d063c2-a494-4d03-9065-f3d481c63d1b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:44:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 15:44:33 user nova-compute[73079]:  {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:44:33 user nova-compute[73079]: WARNING os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 15:44:33 user nova-compute[73079]: 
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --login {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d0b84-54d9-4967-b303-c5fca43dc161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260]
Aug 17 15:44:33 user nova-compute[73079]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260] successful.
Aug 17 15:44:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[43478644-7ebe-4674-8cdf-e45667ee0726]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[572978cf-9d05-434e-92b3-164ec96545b6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 (non-flash)
Aug 17 15:44:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 (non-flash)
Aug 17 15:44:33 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to 172.16.0.220:3260 {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73079) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73079) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e4bfa3-ba9a-48b9-a3f0-1f5c56bd852a]: (4, ('- - 0', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:33 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73079) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZFkyGBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73079) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26562326134363835', 'path': '/dev/sdb'} {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562326134363835', 'path': '/dev/sdb'} {{(pid=73079) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG nova.objects.instance [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:44:34 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 15:44:34 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:44:34 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:44:34 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:44:34 user nova-compute[73079]:   <serial>6dba8d51-757e-482c-8cd9-8253298ffde2</serial>
Aug 17 15:44:34 user nova-compute[73079]: </disk>
Aug 17 15:44:34 user nova-compute[73079]:  {{(pid=73079) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 15:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73079) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 15:44:35 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] No VIF found with MAC fa:16:3e:20:55:1a, not building metadata {{(pid=73079) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 15:44:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:44:35 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-afbc6d76-b2f6-4d9b-aa72-c09b4d03d1ff tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.393s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:44:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:44:37 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:44:37 user nova-compute[73079]: INFO nova.compute.manager [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Detaching volume 6dba8d51-757e-482c-8cd9-8253298ffde2
Aug 17 15:44:37 user nova-compute[73079]: INFO nova.virt.block_device [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Attempting to driver detach volume 6dba8d51-757e-482c-8cd9-8253298ffde2 from mountpoint /dev/vdb
Aug 17 15:44:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Attempting to detach device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config. {{(pid=73079) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 15:44:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:44:37 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:44:37 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:44:37 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:44:37 user nova-compute[73079]:   <serial>6dba8d51-757e-482c-8cd9-8253298ffde2</serial>
Aug 17 15:44:37 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:44:37 user nova-compute[73079]: </disk>
Aug 17 15:44:37 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:44:37 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the persistent domain config.
Aug 17 15:44:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config. {{(pid=73079) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 15:44:37 user nova-compute[73079]: DEBUG nova.virt.libvirt.guest [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 15:44:37 user nova-compute[73079]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 15:44:37 user nova-compute[73079]:   <source dev="/dev/sdb"/>
Aug 17 15:44:37 user nova-compute[73079]:   <target dev="vdb" bus="virtio"/>
Aug 17 15:44:37 user nova-compute[73079]:   <serial>6dba8d51-757e-482c-8cd9-8253298ffde2</serial>
Aug 17 15:44:37 user nova-compute[73079]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 15:44:37 user nova-compute[73079]: </disk>
Aug 17 15:44:37 user nova-compute[73079]:  {{(pid=73079) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-41e5dd5f-2fd1-4246-bbbd-b12b03795f3d None None] Received event <DeviceRemovedEvent: 1692287078.1048295, bb94614c-577e-4446-8d5f-b025586f02b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73079) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.driver [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 15:44:38 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully detached device vdb from instance bb94614c-577e-4446-8d5f-b025586f02b6 from the live domain config.
Aug 17 15:44:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] calling os-brick to detach iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f27e85216c0>, {'target_iqns': ['iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZFkyGBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 15:44:38 user nova-compute[73079]: WARNING os_brick.initiator.connectors.base [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2', 0)] {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c7dba3-d391-4c58-b92e-12d6791fc0f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be932eb-ea38-41bf-aa1b-e6ebeb061b5f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 (non-flash)\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 (non-flash)
Aug 17 15:44:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 (non-flash)
Aug 17 15:44:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f27e82fc430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2'): ({'sdb'}, set())}) {{(pid=73079) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Removing single pathed devices sdb {{(pid=73079) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a632b01-7fb2-4867-8b57-68005387a75e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fbb72f-1ef7-4707-9e1c-7c599786c185]: (4, ('ok\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Flushing IO for device /dev/sdb {{(pid=73079) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdac79c-b115-4445-bbae-b6dca8cd6f6f]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73079) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[1999fe9b-a573-43a7-950b-65e155cee112]: (4, ('1', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.linuxscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] SCSI volumes sdb have been removed. {{(pid=73079) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2')] {{(pid=73079) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[942aa778-94b2-499d-b87e-0729612a69b9]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --logout {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[20689b00-4212-4d58-8e66-1786f23c40b9]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260]
Aug 17 15:44:38 user nova-compute[73079]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2, portal: 172.16.0.220,3260] successful.
Aug 17 15:44:38 user nova-compute[73079]:  stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op delete {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dba8d51-757e-482c-8cd9-8253298ffde2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84615) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb6290-ec25-481f-a1ca-6775ced51d4a]: (4, ('', '')) {{(pid=84615) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73079) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.base [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] <== disconnect_volume: return (262ms) None {{(pid=73079) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 15:44:38 user nova-compute[73079]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Disconnected iSCSI Volume {{(pid=73079) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 15:44:39 user nova-compute[73079]: DEBUG nova.objects.instance [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'flavor' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:44:39 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-c0a1b459-51fb-48b7-bc37-e84ae485c4bc tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.630s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:44:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:44:54 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:44:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:45:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:45:07 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:45:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:45:08 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.1578369140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:45:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:45:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:45:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:15 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:45:20 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:25 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:30 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:45:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:45:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:45:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:45:35 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:40 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:45:45 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:50 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquired lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Forcefully refreshing network info cache for instance {{(pid=73079) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG nova.objects.instance [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lazy-loading 'info_cache' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG nova.network.neutron [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [{"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Releasing lock "refresh_cache-bb94614c-577e-4446-8d5f-b025586f02b6" {{(pid=73079) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 15:45:55 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updated the network info_cache for instance {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 15:45:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:56 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:45:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:00 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:01 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:01 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:46:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 15:46:08 user nova-compute[73079]: DEBUG oslo_concurrency.processutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73079) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 15:46:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:46:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.156864166259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Instance bb94614c-577e-4446-8d5f-b025586f02b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73079) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:46:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:10 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:10 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:14 user nova-compute[73079]: INFO nova.compute.manager [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Terminating instance
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.compute.manager [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Start destroying the instance on the hypervisor. {{(pid=73079) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-1f19ffc3-42b9-4a4f-891f-c7c7706dc2d0 req-5bf53e8e-63aa-43f6-a6b3-6864261220c7 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-vif-unplugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1f19ffc3-42b9-4a4f-891f-c7c7706dc2d0 req-5bf53e8e-63aa-43f6-a6b3-6864261220c7 service nova] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1f19ffc3-42b9-4a4f-891f-c7c7706dc2d0 req-5bf53e8e-63aa-43f6-a6b3-6864261220c7 service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-1f19ffc3-42b9-4a4f-891f-c7c7706dc2d0 req-5bf53e8e-63aa-43f6-a6b3-6864261220c7 service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-1f19ffc3-42b9-4a4f-891f-c7c7706dc2d0 req-5bf53e8e-63aa-43f6-a6b3-6864261220c7 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] No waiting events found dispatching network-vif-unplugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.compute.manager [req-1f19ffc3-42b9-4a4f-891f-c7c7706dc2d0 req-5bf53e8e-63aa-43f6-a6b3-6864261220c7 service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-vif-unplugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 for instance with task_state deleting. {{(pid=73079) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Instance destroyed successfully.
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.objects.instance [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lazy-loading 'resources' on Instance uuid bb94614c-577e-4446-8d5f-b025586f02b6 {{(pid=73079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.virt.libvirt.vif [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T15:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-74284325',display_name='tempest-SnapshotDataIntegrityTests-server-74284325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-74284325',id=53,image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygjRpASOCabJxR5gXpUbuEofnGaILgeoWFvPNJ5dhYcV4luaueJqFuIQK17txeniBlwDUUaskGtMopbg4Ak3QQWbRwZuqb/LUQB7PtI0AYrl+OS/lLHMu3fPYsCECffQ==',key_name='tempest-keypair-281914772',keypairs=<?>,launch_index=0,launched_at=2023-08-17T15:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6e0f2b04a584e81b69d3e9d31281e0c',ramdisk_id='',reservation_id='r-pi9rlqxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1520146-7ad6-41ad-91e3-e68a652af0d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1002526285',owner_user_name='tempest-SnapshotDataIntegrityTests-1002526285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T15:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59e7197908c14fa9a1b38dc68d6a9611',uuid=bb94614c-577e-4446-8d5f-b025586f02b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Converting VIF {"id": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "address": "fa:16:3e:20:55:1a", "network": {"id": "1050c4b7-3450-4469-8bb2-512e77846d26", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-785750484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6e0f2b04a584e81b69d3e9d31281e0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a95ac3d-af", "ovs_interfaceid": "2a95ac3d-af17-45fe-bd5c-535d6d83d158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.network.os_vif_util [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af') {{(pid=73079) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG os_vif [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af') {{(pid=73079) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a95ac3d-af, bridge=br-int, if_exists=True) {{(pid=73079) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:14 user nova-compute[73079]: INFO os_vif [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:55:1a,bridge_name='br-int',has_traffic_filtering=True,id=2a95ac3d-af17-45fe-bd5c-535d6d83d158,network=Network(1050c4b7-3450-4469-8bb2-512e77846d26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a95ac3d-af')
Aug 17 15:46:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Deleting instance files /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6_del
Aug 17 15:46:14 user nova-compute[73079]: INFO nova.virt.libvirt.driver [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Deletion of /opt/stack/data/nova/instances/bb94614c-577e-4446-8d5f-b025586f02b6_del complete
Aug 17 15:46:14 user nova-compute[73079]: INFO nova.compute.manager [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 15:46:14 user nova-compute[73079]: DEBUG oslo.service.loopingcall [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73079) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.compute.manager [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Deallocating network for instance {{(pid=73079) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 15:46:14 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] deallocate_for_instance() {{(pid=73079) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 15:46:15 user nova-compute[73079]: DEBUG nova.network.neutron [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Updating instance_info_cache with network_info: [] {{(pid=73079) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 15:46:15 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Took 0.73 seconds to deallocate network for instance.
Aug 17 15:46:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:15 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:46:15 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:46:15 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:15 user nova-compute[73079]: INFO nova.scheduler.client.report [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Deleted allocations for instance bb94614c-577e-4446-8d5f-b025586f02b6
Aug 17 15:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-77760109-dfd4-4242-b082-eefc6550e38d tempest-SnapshotDataIntegrityTests-1002526285 tempest-SnapshotDataIntegrityTests-1002526285-project-member] Lock "bb94614c-577e-4446-8d5f-b025586f02b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] Acquiring lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:46:16 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] Lock "bb94614c-577e-4446-8d5f-b025586f02b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:46:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] No waiting events found dispatching network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 15:46:16 user nova-compute[73079]: WARNING nova.compute.manager [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received unexpected event network-vif-plugged-2a95ac3d-af17-45fe-bd5c-535d6d83d158 for instance with vm_state deleted and task_state None.
Aug 17 15:46:16 user nova-compute[73079]: DEBUG nova.compute.manager [req-a6739653-c71e-4a22-b42b-aae6f4136633 req-fc6dc937-643b-4c4b-a625-756f41cf684d service nova] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Received event network-vif-deleted-2a95ac3d-af17-45fe-bd5c-535d6d83d158 {{(pid=73079) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 15:46:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692287174.8261125, bb94614c-577e-4446-8d5f-b025586f02b6 => Stopped> {{(pid=73079) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 15:46:29 user nova-compute[73079]: INFO nova.compute.manager [-] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] VM Stopped (Lifecycle Event)
Aug 17 15:46:29 user nova-compute[73079]: DEBUG nova.compute.manager [None req-6435e2af-302f-41a4-8384-7d6b67d3d470 None None] [instance: bb94614c-577e-4446-8d5f-b025586f02b6] Checking state {{(pid=73079) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:39 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:44 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:46:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:49 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:46:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:54 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Starting heal instance info cache {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 15:46:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Rebuilding the list of instances to heal {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 15:46:57 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Didn't find any instances for network info cache update. {{(pid=73079) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 15:46:57 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:58 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73079) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73079) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 15:46:59 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:02 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:03 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:03 user nova-compute[73079]: DEBUG nova.compute.manager [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73079) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 15:47:04 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:04 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:05 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:08 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73079) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 15:47:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:47:09 user nova-compute[73079]: WARNING nova.virt.libvirt.driver [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.183761596679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=73079) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73079) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing inventories for resource provider dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating ProviderTree inventory for provider dea4593c-fa71-4579-88eb-51499faa7caf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 15:47:09 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Updating inventory in ProviderTree for provider dea4593c-fa71-4579-88eb-51499faa7caf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 15:47:10 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing aggregate associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, aggregates: None {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 15:47:10 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Refreshing trait associations for resource provider dea4593c-fa71-4579-88eb-51499faa7caf, traits: HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NODE {{(pid=73079) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 15:47:10 user nova-compute[73079]: DEBUG nova.compute.provider_tree [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed in ProviderTree for provider: dea4593c-fa71-4579-88eb-51499faa7caf {{(pid=73079) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 15:47:10 user nova-compute[73079]: DEBUG nova.scheduler.client.report [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Inventory has not changed for provider dea4593c-fa71-4579-88eb-51499faa7caf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73079) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 15:47:10 user nova-compute[73079]: DEBUG nova.compute.resource_tracker [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Compute_service record updated for user:user {{(pid=73079) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 15:47:10 user nova-compute[73079]: DEBUG oslo_concurrency.lockutils [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=73079) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 15:47:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:11 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:12 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:12 user nova-compute[73079]: DEBUG oslo_service.periodic_task [None req-a6b1c2c0-7563-4250-96d6-541350d1d9b9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73079) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 15:47:14 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:19 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:24 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:29 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 15:47:34 user nova-compute[73079]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73079) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}